-- Logs begin at Mon 2022-08-22 04:46:53 UTC, end at Mon 2022-08-22 06:05:41 UTC. -- Aug 22 05:29:53.944431 dv-cinder-853910-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 22 05:29:53.953778 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 22 05:29:53.955198 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 05:29:53 2022] *** Aug 22 05:29:53.955198 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 05:29:53.955198 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 05:29:53.955198 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: nodename: dv-cinder-853910-1-iscsi Aug 22 05:29:53.955198 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: machine: x86_64 Aug 22 05:29:53.955198 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: clock source: unix Aug 22 05:29:53.955198 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: pcre jit disabled Aug 22 05:29:53.955198 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: detected number of CPU cores: 4 Aug 22 05:29:53.955198 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: current working directory: / Aug 22 05:29:53.955198 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: detected binary path: /usr/bin/uwsgi-core Aug 22 05:29:53.955950 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: your processes number limit is 47680 Aug 22 05:29:53.955950 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: your memory page size is 4096 bytes Aug 22 05:29:53.955950 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: detected max file descriptor number: 2048 Aug 22 05:29:53.955950 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: lock engine: pthread robust mutexes Aug 22 05:29:53.955950 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: thunder lock: enabled Aug 22 05:29:53.955950 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 22 05:29:53.955950 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 05:29:53.994338 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: Python main interpreter initialized at 0x55e8f960a9c0 Aug 22 05:29:53.994338 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: python threads support enabled Aug 22 05:29:53.994338 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: your server socket listen backlog is limited to 100 connections Aug 22 05:29:53.994338 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: your mercy for graceful operations on workers is 90 seconds Aug 22 05:29:53.994692 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 05:29:53.994768 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: *** Operational MODE: preforking *** Aug 22 05:29:53.995005 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: *** uWSGI is running in multiple interpreter mode *** Aug 22 05:29:53.995005 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: spawned uWSGI master process (pid: 105764) Aug 22 05:29:53.995207 dv-cinder-853910-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 22 05:29:53.995768 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: spawned uWSGI worker 1 (pid: 105765, cores: 1) Aug 22 05:29:53.996109 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: spawned uWSGI worker 2 (pid: 105766, cores: 1) Aug 22 05:29:53.996274 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 05:29:54.649051 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 05:29:54.650799 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 05:29:55.717185 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 05:29:55.717185 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: from cryptography.utils import int_from_bytes Aug 22 05:29:55.717829 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 05:29:55.717829 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: from cryptography.utils import int_from_bytes Aug 22 05:29:55.721442 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 05:29:55.721442 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: from cryptography.utils import int_from_bytes Aug 22 05:29:55.721896 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 05:29:55.721896 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: from cryptography.utils import int_from_bytes Aug 22 05:29:58.192007 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 05:29:58.192587 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 05:29:58.192959 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 05:29:58.193053 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 05:29:58.193141 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 05:29:58.193218 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 05:29:58.193290 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 05:29:58.193363 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 05:29:58.193429 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 05:29:58.193493 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 05:29:58.193679 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.193776 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.193985 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.194087 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.194286 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.194401 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.194601 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.194701 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.194923 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.195040 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.195230 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.195341 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.195630 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.195730 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.195887 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.196103 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.196254 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.196440 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.196583 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.196682 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.196769 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.197005 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.197138 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-1-iscsi {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.197328 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-1-iscsi {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.197467 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.197648 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.197780 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.197960 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.198044 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.198242 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.198376 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.198510 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.198674 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.198817 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.198947 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.199147 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.199327 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.199463 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.199643 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.200087 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.200219 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.200334 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.200441 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.200557 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.200670 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.200870 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.201033 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.201170 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.201296 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.201510 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.201701 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.201847 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.201985 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.202109 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.202236 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.202371 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.202484 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.202717 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.202895 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.203028 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.203168 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-1-iscsi {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.203400 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.203602 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-1-iscsi {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.203764 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.203898 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.204030 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.204165 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.204325 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.204466 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.204728 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.204910 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.205059 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.205198 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.205419 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.205549 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.205672 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.205803 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.205936 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.206076 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.206209 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.206332 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.206528 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.206716 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.206859 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.206998 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.207129 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.207259 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.207383 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.207510 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.207788 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.208386 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.208528 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.208668 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.208792 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.208914 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.209048 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.209178 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.209336 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.209468 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.209672 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.209851 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.210000 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.210132 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.210266 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.210390 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.210512 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.210632 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.210810 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.210944 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.211074 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.211198 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.211391 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.211615 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.211756 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.211884 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.212011 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.212147 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.212282 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.212413 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.212545 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.212667 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.212880 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.213052 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.213201 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.213339 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.213471 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.213605 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.213727 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.213849 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.214020 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.214162 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.214360 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.214549 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.214682 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.214807 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.214941 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.215064 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.215270 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.215464 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.215711 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.215872 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.216000 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.216122 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.216246 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.216376 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.216499 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.216630 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.216791 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.216923 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.217133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.217323 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.217468 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.217607 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.217731 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.217853 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.218012 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.218145 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.218307 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.218454 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.218613 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.218745 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.218912 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.219043 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.219254 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.219444 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.219973 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.220102 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.220226 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.220348 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.220488 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.220612 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.220733 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.220852 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.221009 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.221152 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.221320 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.221476 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.221646 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.221771 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.221892 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.222013 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.222217 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.222396 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.222531 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.222657 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.222780 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.222916 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.223047 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.223267 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.223938 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.224072 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.224212 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.224212 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.224531 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.224652 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.224773 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.224893 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.225023 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.225154 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.225285 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.225407 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.225528 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.225657 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.225872 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.226008 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.226130 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.226257 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.226379 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.226499 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.226632 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.226770 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.226892 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.227022 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.227143 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.227272 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.227401 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.227531 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.227685 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.227810 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.227931 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.228088 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.228222 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.228389 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.228515 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.228689 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.228816 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.229005 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.229131 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.229308 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.229434 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.229610 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.229735 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.229910 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.230048 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.230205 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.230335 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.230506 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.230631 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.230809 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.230943 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.231106 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.231229 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.231403 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.231542 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.231731 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.231865 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.232028 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.232154 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.232326 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.232451 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.232624 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.232767 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.232923 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.233047 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.233217 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.233334 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.233510 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.233644 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.233812 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.233935 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.234116 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.234240 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.234416 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.234541 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.234711 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.234833 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.235008 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.235141 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.235321 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.235446 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.235647 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.235774 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.235976 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.236121 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.236261 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.236390 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.236560 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:29:58.236685 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.236896 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.237021 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.237230 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.237354 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.237545 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.237671 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.237853 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.237992 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.238166 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.238301 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.238489 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.238613 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.238796 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.238947 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.239214 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.239681 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.239824 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.239948 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.240069 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.240199 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.240323 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.240444 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.240572 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.240694 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.240834 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.240978 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.241119 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.241242 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.241375 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.241496 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.241624 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.241760 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.241928 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.242054 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.242247 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.242389 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.242573 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.242701 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.242885 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.243010 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.243204 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.243339 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.243537 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.243704 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.243899 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.244059 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.244214 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.244381 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.244594 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.244719 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.244890 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.245016 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.245207 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.245333 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.245535 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.245662 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.245857 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.245983 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.246187 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.246321 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.246474 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.246611 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.246775 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.246898 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.247084 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.247223 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.247393 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.247519 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.247726 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.247868 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.248034 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.248169 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.248341 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.248467 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.248654 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.248780 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.248971 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.249105 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.249280 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.249403 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.249587 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.249720 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.249898 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.250024 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.250205 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.250330 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.250512 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.250637 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.250818 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.250946 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.251120 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.251245 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.251421 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.251547 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.251758 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.251893 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.252062 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.252187 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.252364 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.252489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.252667 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.252792 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.252974 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.253100 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.253273 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.253404 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.253580 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.253704 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.253885 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.254010 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.254190 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.254329 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.254494 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.254662 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.255242 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.255378 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.255378 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.255661 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.255788 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.255910 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.256033 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.256167 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.256368 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.256504 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.256627 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.256749 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.256870 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.256990 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.257113 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.257254 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.257376 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.257497 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.257618 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.257738 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.257903 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.258029 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.258212 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.258339 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.258537 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.258663 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.258844 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.258970 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.259152 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.259286 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.259466 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.259671 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.259811 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.259932 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.260104 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.260232 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.260409 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.260541 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.260717 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.260842 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.261038 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.261164 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.261335 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.261469 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.261651 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.261774 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.261969 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.262092 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.262288 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.262424 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.262590 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.262725 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.262896 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.263030 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.263199 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.263343 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.263498 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.263637 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.263826 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.263965 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.264133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.264269 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.264432 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.264568 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.264730 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.264857 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.265029 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.265155 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.265327 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.265462 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.265627 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.265750 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.265935 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.266060 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.266235 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.266373 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.266562 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.266685 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.266816 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.266945 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.267108 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.267233 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.267422 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.267546 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.267757 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.267883 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.268067 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.268191 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.268375 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.268508 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.268701 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.268831 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.269015 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.269137 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.269320 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.269446 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.269633 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.269772 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.269938 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.270063 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.270339 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.270485 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.270655 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.270789 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.270973 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.271096 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.271285 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.271419 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.271627 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.271770 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.271935 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.272067 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.272243 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.272368 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.272563 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.272687 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.272870 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.272998 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.273202 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.273326 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.273472 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.273609 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.273784 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.273910 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.274093 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.274217 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.274416 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.274553 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.274722 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.274856 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.275034 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.275158 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.275341 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.275494 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.275714 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.275839 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.276034 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.276167 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.276336 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.276459 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.276660 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.276808 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.276931 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.277053 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.277246 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.277371 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.277547 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.277680 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.277858 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.277982 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.278160 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.278286 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.278476 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.278611 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.278782 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.278916 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.279097 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.279222 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.279391 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.279518 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.279724 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.279853 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.280045 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.280171 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.280365 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.280492 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.280666 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.280789 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.280970 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.281102 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.281288 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.281414 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.281594 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.281719 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.281897 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.282021 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.282202 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.282329 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.282503 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.282628 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.282803 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.282929 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.283109 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.283235 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.283419 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.283542 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.283748 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.283882 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.284053 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.284185 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.284347 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.284480 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.284657 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.284791 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.284960 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.285088 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.285258 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.285387 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.285556 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.285696 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.285932 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.286265 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.286666 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.286876 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.287002 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.287135 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.287268 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.287400 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.287524 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.287672 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.287808 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.287945 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.288078 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.288208 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.288331 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.288452 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.288583 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.288706 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.288836 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.288958 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.289079 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.289200 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.289331 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.289461 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.289585 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.289707 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.289842 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.289965 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.290103 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.290226 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.290384 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.290510 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.290701 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.290826 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.291006 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.291132 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.291319 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.291451 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.291632 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.291771 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.291945 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.292071 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.292261 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.292387 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.292574 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.292707 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.292879 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.293018 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.293188 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.293322 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.293497 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.293631 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.293804 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.293923 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.294110 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.294245 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.294415 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.294548 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.294719 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.294857 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.295032 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.295159 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.295329 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.295453 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.295647 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.295786 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.295958 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.296084 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.296265 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.296389 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.296577 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.296829 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.297035 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.297158 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.297291 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.297453 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.297577 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.297766 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.298034 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.298159 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.298374 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.298499 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.298692 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.298814 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.299011 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.299147 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.299335 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.299469 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.299666 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.299869 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.299995 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.300116 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.300245 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.300367 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.300520 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.300646 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.300854 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.300995 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.301120 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.301241 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.301430 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.301636 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.301883 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.302302 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.302436 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.302569 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.302695 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.302817 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.302952 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.303075 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.303197 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.303319 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.303426 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.303550 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.303699 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.303834 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.303957 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.304087 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.304210 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.304332 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.304462 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.304584 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.304705 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.304835 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.304957 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.305112 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.305231 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.305427 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.305561 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.305735 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.305861 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.306060 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.306187 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.306368 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.306507 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.306678 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.306803 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.306987 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.307195 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.307322 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.307461 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.307626 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.307753 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.307945 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.308075 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.308243 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.308379 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.308542 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.308668 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.308843 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.308977 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.309150 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.309276 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.309459 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.309594 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.309766 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.309891 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.310064 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.310192 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.310371 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.310496 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.310671 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.310807 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.310975 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.311101 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.311278 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.311412 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.311594 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.311728 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.311902 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.312029 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.312200 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.312326 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.312504 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.312636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.312804 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.312930 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.313102 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.313237 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.313401 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.313535 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.313699 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.313824 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.313997 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.314114 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.314297 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.314433 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.314597 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.314728 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.314894 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.315017 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.315200 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.315332 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.315496 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.315651 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.315826 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.315951 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.316121 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.316246 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.316422 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.316556 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.316723 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.316849 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.317038 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.317335 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.317925 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.318060 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.318195 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.318326 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.318464 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.318587 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.318709 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.318830 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.318956 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.319079 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.319221 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.319344 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.319466 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.319635 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.319778 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.319917 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.320042 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.320163 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.320284 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.320405 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.320526 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.320665 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.320788 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.320912 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.321035 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.321157 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.321278 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.321409 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.321545 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.321670 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.321825 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.321952 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.322135 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.322262 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.322429 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.322553 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.322728 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.322854 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.323026 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.323154 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.323322 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.323455 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.323641 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.323768 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.323949 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.324076 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.324248 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.324371 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.324528 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.324661 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.324869 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.324993 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.325126 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.325251 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.325426 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.325560 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.325732 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.325857 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.326038 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.326162 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.326344 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.326478 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.326664 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.326788 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.326966 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.327092 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.327277 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.327415 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.327632 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.327764 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.327916 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.328055 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.328227 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.328362 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.328533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.328658 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.328841 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.328964 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.329139 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.329271 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.329438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.329580 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.329752 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.329875 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.330054 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.330179 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.330358 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.330483 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.330659 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.330791 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.330965 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.331091 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.331274 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.331397 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.331587 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.331728 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.331900 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.332026 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.332203 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.332328 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.332501 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.332667 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.333478 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.333785 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.334370 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.334925 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.335058 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.335193 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.335353 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.335476 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.335611 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.335736 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.335858 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.335993 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.336117 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.336246 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.336368 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.336488 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.336608 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.336738 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.336862 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.336985 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.337106 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.337226 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.337346 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.337476 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.337606 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.337731 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.337864 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.337997 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.338128 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.338250 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.338379 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.338510 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.338632 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.338753 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.338884 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.339006 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.339127 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.339248 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.339377 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.339499 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.339694 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.339826 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.339950 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.340079 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.340201 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.340322 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.340451 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.340564 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.340677 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.340796 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.340916 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.341047 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.341173 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.341293 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.341415 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.341537 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.341667 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.341798 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.341920 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.342043 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.342163 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.342283 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.342404 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.342533 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.342656 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.342777 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.342898 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.343019 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.343149 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.343282 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.343405 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.343527 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.343663 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.343813 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.343952 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.344117 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.344243 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.344429 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.344917 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.345104 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.345243 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.345405 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.345528 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.345709 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.345834 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.346011 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.346145 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.346331 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.346484 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.346637 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.346790 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.346956 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.347090 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.347367 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.347493 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.347705 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.347832 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.348010 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.348145 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.348354 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.348678 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.349110 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.349110 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.349370 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.349494 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.349615 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.349758 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.349890 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.350015 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.350137 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.350267 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.350406 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.350530 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.350661 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.350792 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.350916 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.351037 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.351167 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.351345 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.351473 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.351685 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.351814 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.352049 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.352191 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.352370 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.352496 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.352676 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.352801 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.352991 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.353116 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.353313 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.353438 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.353613 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.353742 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.353913 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.354040 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.354218 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.354343 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.354520 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.354647 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.354822 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.354948 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.355138 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.355272 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.355440 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.355567 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.355772 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.355908 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.356083 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.356217 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.356388 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.356524 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.356687 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.356823 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.356986 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.357112 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.357301 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.357438 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.357600 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.357727 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.357909 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.358027 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.358218 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.358352 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.358525 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.358649 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.358830 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.358963 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.359129 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.359263 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.359447 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.359596 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.359773 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.359900 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.360075 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.360202 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.360377 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.360503 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.360679 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.360804 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.361000 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.361125 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.361302 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.361427 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.361617 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.361740 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.361925 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.362059 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.362320 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.362448 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.362570 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.362702 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.362840 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.362974 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.363143 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.363273 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.363453 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.363667 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.363795 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.363936 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.364193 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.364622 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.364758 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.364892 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.364892 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.365141 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.365263 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.365385 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.365385 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.365630 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.365754 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.365867 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.365995 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.366119 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.366242 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.366376 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.366501 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.366632 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.366804 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.366931 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.367104 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.367240 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.367421 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.367554 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.367733 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.367869 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.368049 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.368176 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.368354 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.368478 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.368650 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.368774 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.368949 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.369074 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.369246 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.369379 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.369561 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.369684 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.369864 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.369991 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.370184 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.370318 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.370486 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.370686 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.370811 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.370939 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.371062 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.371183 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.371363 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.371505 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.371723 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.371860 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.372027 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.372152 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.372336 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.372476 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.372649 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.372775 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.372960 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.373086 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.373269 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.373404 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.373581 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.373693 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.373891 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.374005 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.374201 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.374316 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.374512 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.374719 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.374854 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.375042 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.375178 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.375351 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.375486 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.375685 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.375813 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.375995 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.376137 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.376304 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.376430 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.376611 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.376865 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.376991 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.377197 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.377332 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.377498 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.377622 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.377804 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.378009 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.378135 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.378246 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.378415 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.378542 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.378730 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.378866 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.379044 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.379177 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.379354 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.379493 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.379803 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.380371 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.380503 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.380626 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.380757 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.380889 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.381021 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.381145 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.381273 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.381395 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.381525 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.381648 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.381780 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.381912 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.382042 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.382173 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.382297 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.382432 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.382555 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.382685 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.382887 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.383016 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.383204 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.383339 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.383512 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.383689 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.383854 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.383982 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.384158 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.384291 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.384469 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.384587 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.384778 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.384895 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.385093 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.385221 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.385406 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.385532 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.385715 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.385839 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.386025 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.386153 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.386325 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.386451 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.386633 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.386766 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.386947 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.387142 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.387269 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.387452 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.387606 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.387805 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.387933 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.388128 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.388255 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.388450 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.388575 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.388768 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.388895 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.389083 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.389317 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.389446 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.389636 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.389772 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.389969 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.390094 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.390273 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.390396 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.390578 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.390705 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.390877 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.391003 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.391191 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.391318 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.391496 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.391640 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.391823 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.391960 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.392125 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.392257 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.392425 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.392558 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.392733 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.392952 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.393071 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.393298 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.393435 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.393613 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.393738 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.393922 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.394044 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.394240 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.394365 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.394544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.394669 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.394843 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.395072 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.395256 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.395793 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.395945 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.396111 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.396250 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.396374 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.396506 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.396638 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.396760 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.396880 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.397010 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.397133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.397269 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.397392 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.397514 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.397645 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.397770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.397925 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.398059 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.398230 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.398357 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.398530 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.398658 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.398859 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.398987 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.399162 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.399288 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.399462 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.399620 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.399802 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.399929 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.400108 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.400234 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.400411 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.400556 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.400694 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.400818 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.400996 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.401123 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.401296 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.401436 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.401603 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.401738 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.401901 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.402027 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.402203 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.402339 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.402501 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.402708 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.402832 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.402960 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.403081 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.403216 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.403382 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.403516 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.403721 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.403847 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.404028 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.404166 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.404337 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.404472 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.404641 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.404769 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.404954 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.405073 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.405258 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.405384 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.405564 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.405698 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.405866 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.405996 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.406183 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.406342 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.406465 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.406586 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.406790 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.406914 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.407107 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.407309 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.407437 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.407660 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.407813 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.407977 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.408114 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.408305 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.408431 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.408628 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.408755 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.408933 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.409060 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.409233 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.409487 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.409627 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.409819 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.409946 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.410127 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.410259 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.410432 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.410576 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.410736 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.410904 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.411530 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.411707 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.411707 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.411959 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.412082 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.412206 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.412330 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.412451 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.412583 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.412706 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.412828 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.412949 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.413071 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.413191 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.413324 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.413447 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.413579 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.413709 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.413832 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.413960 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.414123 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.414251 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.414433 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.414558 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.414743 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.414879 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.415052 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.415172 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.415364 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.415492 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.415697 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.415843 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.416009 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.416135 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.416296 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.416419 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.416602 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.416737 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.416907 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.417032 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.417211 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.417346 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.417522 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.417650 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.417846 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.417972 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.418153 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.418285 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.418452 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.418579 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.418758 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.418889 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.419071 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.419196 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.419384 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.419518 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.419726 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.419852 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.420057 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.420194 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.420372 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.420491 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.420679 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.420804 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.420980 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.421114 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.421295 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.421420 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.421599 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.421719 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.421922 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.422064 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.422254 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.422380 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.422576 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.422701 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.422896 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.423031 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.423203 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.423328 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.423502 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.423645 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.423831 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.423959 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.424137 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.424272 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.424451 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.424577 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.424754 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.424882 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.425054 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.425251 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.425378 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.425509 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.425631 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.425752 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.425923 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.426048 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.426223 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.426421 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.426681 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.427106 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.427106 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.427341 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.427341 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.427638 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.427779 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.427903 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.428028 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.428165 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.428297 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.428429 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.428551 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.428673 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.428801 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.428932 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.429074 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.429198 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.429319 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.429440 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.429561 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.429682 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.429843 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.429973 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.430145 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.430273 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.430443 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.430562 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.430740 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.430874 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.431065 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.431192 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.431386 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.431510 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.431716 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.431844 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.432024 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.432149 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.432327 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.432463 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.432632 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.432757 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.432934 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.433057 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.433249 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.433384 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.433565 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.433691 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.433875 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.434007 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.434175 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.434310 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.434493 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.434620 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.434799 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.434923 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.435106 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.435316 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.435443 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.435607 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.435733 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.435856 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.436020 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.436147 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.436330 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.436490 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.436651 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.436776 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.436960 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.437085 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.437259 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.437383 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.437571 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.437695 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.437883 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.438009 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.438195 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.438329 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.438502 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.438640 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.438811 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.438937 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.439139 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.439263 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.439444 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.439603 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.439777 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.439904 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.440085 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.440223 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.440391 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.440527 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.440697 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.440822 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.441007 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.441131 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.441311 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.441443 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.441618 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.441744 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.441930 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.442144 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.442780 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.442918 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.443042 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.443179 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.443304 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.443437 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.443612 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.443741 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.443864 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.443986 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.444107 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.444229 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.444370 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.444505 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.444628 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.444774 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.444910 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.445110 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.445230 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.445425 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.445558 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.445734 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.445861 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.446036 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.446164 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.446286 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 05:29:58.446408 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.446707 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.447026 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.447374 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.447730 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.448048 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.448364 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.448675 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:29:58.448926 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 05:29:58.603113 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO dbcounter [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] Registered counter for database nova_api Aug 22 05:29:58.605915 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO dbcounter [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] Registered counter for database nova_api Aug 22 05:29:58.625580 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG oslo_db.sqlalchemy.engines [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:29:58.627415 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_db.sqlalchemy.engines [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:29:58.632345 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG dbcounter [-] [105765] Writer thread running {{(pid=105765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:29:58.634985 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG dbcounter [-] [105766] Writer thread running {{(pid=105766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:29:58.687631 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.context [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),129586bd-1da0-4623-9b26-5cb41c4ec3d8(cell1) {{(pid=105765) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 05:29:58.691034 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.context [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),129586bd-1da0-4623-9b26-5cb41c4ec3d8(cell1) {{(pid=105766) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 05:29:58.691497 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG oslo_concurrency.lockutils [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:29:58.692044 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG oslo_concurrency.lockutils [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:29:58.693699 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG oslo_concurrency.lockutils [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:29:58.694364 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG oslo_concurrency.lockutils [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:29:58.694814 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG oslo_concurrency.lockutils [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:29:58.695463 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:29:58.695956 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:29:58.696874 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG oslo_concurrency.lockutils [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:29:58.697503 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:29:58.698239 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:29:58.698676 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:29:58.698828 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO dbcounter [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] Registered counter for database nova_cell0 Aug 22 05:29:58.700730 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:29:58.702724 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO dbcounter [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] Registered counter for database nova_cell0 Aug 22 05:29:58.704389 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO dbcounter [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] Registered counter for database nova_cell1 Aug 22 05:29:58.709116 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO dbcounter [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] Registered counter for database nova_cell1 Aug 22 05:29:58.712670 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG oslo_db.sqlalchemy.engines [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:29:58.714555 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG oslo_db.sqlalchemy.engines [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:29:58.716452 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_db.sqlalchemy.engines [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:29:58.720089 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_db.sqlalchemy.engines [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:29:58.720943 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG dbcounter [-] [105765] Writer thread running {{(pid=105765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:29:58.723679 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG dbcounter [-] [105766] Writer thread running {{(pid=105766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:29:58.723808 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG dbcounter [-] [105765] Writer thread running {{(pid=105765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:29:58.859781 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG dbcounter [-] [105766] Writer thread running {{(pid=105766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:29:58.869145 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO dbcounter [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] Registered counter for database nova_cell0 Aug 22 05:29:58.870084 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO dbcounter [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] Registered counter for database nova_cell0 Aug 22 05:29:58.877708 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG oslo_db.sqlalchemy.engines [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:29:58.882003 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_db.sqlalchemy.engines [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:29:58.883539 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG dbcounter [-] [105765] Writer thread running {{(pid=105765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:29:58.887070 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG dbcounter [-] [105766] Writer thread running {{(pid=105766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:29:59.218200 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: WARNING keystonemiddleware.auth_token [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 05:29:59.224355 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: WARNING keystonemiddleware.auth_token [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 05:29:59.225915 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: WARNING keystonemiddleware.auth_token [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 05:29:59.231654 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: WARNING keystonemiddleware.auth_token [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 05:29:59.574390 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: WARNING keystonemiddleware.auth_token [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 05:29:59.576055 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: WARNING keystonemiddleware.auth_token [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 05:29:59.580334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: WARNING keystonemiddleware.auth_token [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 05:29:59.582002 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: WARNING keystonemiddleware.auth_token [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 05:29:59.585647 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e8f960a9c0 pid: 105765 (default app) Aug 22 05:29:59.587445 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e8f960a9c0 pid: 105766 (default app) Aug 22 05:29:59.587745 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:29:59.588928 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-1f1f5a95-39ab-491f-95b9-2846f28497d5 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001759 Aug 22 05:29:59.589341 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Mon Aug 22 05:29:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:31:18.362540 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:31:18.363785 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002080 Aug 22 05:31:18.364161 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 22 05:31:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:31:18.379792 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG dbcounter [-] [105765] Writing DB stats nova_api:SELECT=3 {{(pid=105765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:18.380901 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG dbcounter [-] [105765] Writing DB stats nova_cell0:SELECT=3 {{(pid=105765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:18.381778 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG dbcounter [-] [105765] Writing DB stats nova_cell1:SELECT=3 {{(pid=105765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:18.383099 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG dbcounter [-] [105765] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:19.275509 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-8cb59656-2197-4a97-ad18-f596bf8fa15c admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:31:19.308747 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-8cb59656-2197-4a97-ad18-f596bf8fa15c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.938263 Aug 22 05:31:19.309814 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1292 bytes} [Mon Aug 22 05:31:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:21.647105 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:31:21.648065 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-020fdcc4-046d-4786-8a3c-cce26bcb9a43 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 22 05:31:21.648604 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 2/4] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 22 05:31:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:31:22.107505 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-857fd9a0-abd8-4ec3-932b-da4d80d7bceb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256"}} {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:22.128521 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:31:22.128521 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: warnings.warn(msg) Aug 22 05:31:22.160929 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-857fd9a0-abd8-4ec3-932b-da4d80d7bceb admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.506278 Aug 22 05:31:22.162129 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 3/5] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 22 05:31:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:31:22.175693 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG dbcounter [-] [105766] Writing DB stats nova_api:SELECT=3 {{(pid=105766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:22.176864 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG dbcounter [-] [105766] Writing DB stats nova_cell0:SELECT=3 {{(pid=105766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:22.178041 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG dbcounter [-] [105766] Writing DB stats nova_cell1:SELECT=3 {{(pid=105766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:22.179047 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG dbcounter [-] [105766] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:22.394716 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-7d98c0b9-34a7-4eb3-9b48-eb4233c73736 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:22.399149 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:31:22.399149 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: warnings.warn(msg) Aug 22 05:31:22.466778 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-7d98c0b9-34a7-4eb3-9b48-eb4233c73736 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.296691 Aug 22 05:31:22.467363 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 3/6] 10.222.0.18 () {64 vars in 1336 bytes} [Mon Aug 22 05:31:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:24.805973 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-857fd9a0-abd8-4ec3-932b-da4d80d7bceb admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:31:24.807434 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-857fd9a0-abd8-4ec3-932b-da4d80d7bceb admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001932 Aug 22 05:31:24.808100 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 4/7] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 22 05:31:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:31:25.454932 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-f76ca405-ec1d-4b8f-a7c3-c1160f307413 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:25.475707 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:31:25.475707 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: warnings.warn(msg) Aug 22 05:31:25.496974 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-f76ca405-ec1d-4b8f-a7c3-c1160f307413 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.682592 Aug 22 05:31:25.497846 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 4/8] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 22 05:31:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 05:31:25.510401 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-5857cc32-2a31-4acb-8b03-40e8c7bd9913 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:25.513283 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:31:25.513283 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: warnings.warn(msg) Aug 22 05:31:25.548007 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-5857cc32-2a31-4acb-8b03-40e8c7bd9913 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041472 Aug 22 05:31:25.548642 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 5/9] 10.222.0.18 () {64 vars in 1336 bytes} [Mon Aug 22 05:31:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:27.956464 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-f76ca405-ec1d-4b8f-a7c3-c1160f307413 admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:31:27.957477 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-f76ca405-ec1d-4b8f-a7c3-c1160f307413 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Aug 22 05:31:27.957879 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 22 05:31:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:31:28.357579 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-43de84a6-f78c-4ef5-bdb3-2d8bf0061823 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "id": "d2", "name": "ds1G", "vcpus": 1, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:28.378179 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-43de84a6-f78c-4ef5-bdb3-2d8bf0061823 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.414065 Aug 22 05:31:28.378728 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 6/11] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 22 05:31:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 05:31:28.391008 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-694dd9fb-cf9b-4192-8630-893b39f5f9fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:28.419524 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-694dd9fb-cf9b-4192-8630-893b39f5f9fa admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032236 Aug 22 05:31:28.420220 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 6/12] 10.222.0.18 () {64 vars in 1336 bytes} [Mon Aug 22 05:31:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:31:30.753333 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-43de84a6-f78c-4ef5-bdb3-2d8bf0061823 admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:31:30.754473 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-43de84a6-f78c-4ef5-bdb3-2d8bf0061823 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001612 Aug 22 05:31:30.755059 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 7/13] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 22 05:31:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:31:31.213780 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-1174c9ce-3436-49d8-8af6-7b906622ef41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d3", "disk": 10, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:31.236403 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-1174c9ce-3436-49d8-8af6-7b906622ef41 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474736 Aug 22 05:31:31.236944 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 7/14] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 22 05:31:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 05:31:31.249209 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-f5b9543d-e21b-424f-857c-51fde008f15a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:31.280038 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-f5b9543d-e21b-424f-857c-51fde008f15a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034465 Aug 22 05:31:31.280622 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 8/15] 10.222.0.18 () {64 vars in 1336 bytes} [Mon Aug 22 05:31:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:31:33.641485 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-1174c9ce-3436-49d8-8af6-7b906622ef41 admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:31:33.642491 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-1174c9ce-3436-49d8-8af6-7b906622ef41 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 22 05:31:33.642864 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 8/16] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 22 05:31:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:31:34.099979 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-59b7d9b4-3c63-4b86-967c-ac325c4b530a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "swap": 0}} {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:34.119373 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-59b7d9b4-3c63-4b86-967c-ac325c4b530a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.470234 Aug 22 05:31:34.120253 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 9/17] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 22 05:31:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 05:31:34.132419 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-de99a96a-e286-4c87-bc28-9ac6ca244911 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:34.159029 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-de99a96a-e286-4c87-bc28-9ac6ca244911 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030458 Aug 22 05:31:34.160610 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 9/18] 10.222.0.18 () {64 vars in 1336 bytes} [Mon Aug 22 05:31:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:31:36.766107 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-59b7d9b4-3c63-4b86-967c-ac325c4b530a admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:31:36.767385 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-59b7d9b4-3c63-4b86-967c-ac325c4b530a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001791 Aug 22 05:31:36.767858 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 10/19] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 22 05:31:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:31:37.243386 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-91e02f99-c19c-4c8e-9385-2d109f766b94 admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:31:37.270607 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-91e02f99-c19c-4c8e-9385-2d109f766b94 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.494354 Aug 22 05:31:37.271214 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 10/20] 10.222.0.18 () {60 vars in 1292 bytes} [Mon Aug 22 05:31:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:31:39.860208 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-59b7d9b4-3c63-4b86-967c-ac325c4b530a admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:31:39.861330 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-59b7d9b4-3c63-4b86-967c-ac325c4b530a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Aug 22 05:31:39.861697 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 11/21] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 22 05:31:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:31:40.498467 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-3068f72b-82ed-46a7-99c8-2440a40fa3f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1}} {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:40.520108 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-3068f72b-82ed-46a7-99c8-2440a40fa3f7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.651608 Aug 22 05:31:40.520653 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 11/22] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 22 05:31:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 05:31:40.534356 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-d7c8aebd-667e-4143-aee1-9ab9b8de5a16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:40.560745 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-d7c8aebd-667e-4143-aee1-9ab9b8de5a16 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031374 Aug 22 05:31:40.561407 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 12/23] 10.222.0.18 () {64 vars in 1333 bytes} [Mon Aug 22 05:31:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:42.922233 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-3068f72b-82ed-46a7-99c8-2440a40fa3f7 admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:31:42.923529 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-3068f72b-82ed-46a7-99c8-2440a40fa3f7 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002166 Aug 22 05:31:42.924153 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 22 05:31:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:31:43.322516 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-acaef2e1-f4d4-4f25-a98c-a37c428f5704 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:43.342041 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-acaef2e1-f4d4-4f25-a98c-a37c428f5704 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.411561 Aug 22 05:31:43.342551 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 13/25] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 22 05:31:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:31:43.355169 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-b4d64a77-2700-4e61-98db-e1b4926f90b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:43.380963 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-b4d64a77-2700-4e61-98db-e1b4926f90b7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029432 Aug 22 05:31:43.381559 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 13/26] 10.222.0.18 () {64 vars in 1333 bytes} [Mon Aug 22 05:31:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:45.734189 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-acaef2e1-f4d4-4f25-a98c-a37c428f5704 admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:31:45.735874 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-acaef2e1-f4d4-4f25-a98c-a37c428f5704 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002115 Aug 22 05:31:45.736462 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 14/27] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 22 05:31:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:31:46.182319 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-cca7e1e3-7564-463c-9e53-3e8a917633ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "vcpus": 2, "swap": 0, "id": "3"}} {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:46.207415 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-cca7e1e3-7564-463c-9e53-3e8a917633ef admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.463434 Aug 22 05:31:46.207996 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 14/28] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 22 05:31:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:31:46.225388 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-615f9265-2a01-4301-9af0-1e1ba6faadd4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:46.253059 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-615f9265-2a01-4301-9af0-1e1ba6faadd4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036303 Aug 22 05:31:46.253737 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 15/29] 10.222.0.18 () {64 vars in 1333 bytes} [Mon Aug 22 05:31:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:48.727349 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-cca7e1e3-7564-463c-9e53-3e8a917633ef admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:31:48.729206 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-cca7e1e3-7564-463c-9e53-3e8a917633ef admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002373 Aug 22 05:31:48.729606 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 15/30] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 22 05:31:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:31:49.179092 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-4f1806fd-e51a-4f04-9426-56812f29bdc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "id": "4", "rxtx_factor": 1.0}} {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:49.184775 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG dbcounter [-] [105765] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:49.200744 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-4f1806fd-e51a-4f04-9426-56812f29bdc1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.464878 Aug 22 05:31:49.201392 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 16/31] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 22 05:31:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:31:49.214440 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-8823a3fe-8b8c-4a38-87af-fd5dc8143292 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:49.240750 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-8823a3fe-8b8c-4a38-87af-fd5dc8143292 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029943 Aug 22 05:31:49.241618 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 16/32] 10.222.0.18 () {64 vars in 1333 bytes} [Mon Aug 22 05:31:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:51.690979 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-4f1806fd-e51a-4f04-9426-56812f29bdc1 admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:31:51.692095 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-4f1806fd-e51a-4f04-9426-56812f29bdc1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Aug 22 05:31:51.692750 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 17/33] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 22 05:31:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:31:52.127447 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-a235a851-2e26-4f7c-a037-d8b0cf591d59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "name": "m1.xlarge", "ram": 16384}} {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:52.148627 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-a235a851-2e26-4f7c-a037-d8b0cf591d59 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.449589 Aug 22 05:31:52.149177 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 17/34] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 22 05:31:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:31:52.161438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-dfce5c18-d305-4aaf-b7fb-d5201c7aa498 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:31:52.192229 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-dfce5c18-d305-4aaf-b7fb-d5201c7aa498 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034635 Aug 22 05:31:52.192958 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 18/35] 10.222.0.18 () {64 vars in 1333 bytes} [Mon Aug 22 05:31:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:32:10.394773 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-a235a851-2e26-4f7c-a037-d8b0cf591d59 admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:10.395825 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-a235a851-2e26-4f7c-a037-d8b0cf591d59 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 22 05:32:10.396225 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 18/36] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 22 05:32:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:32:10.407281 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG dbcounter [-] [105765] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:10.810314 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-59b139d8-86ea-4040-a6bb-36b16377f69a admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:10.831860 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-59b139d8-86ea-4040-a6bb-36b16377f69a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.429007 Aug 22 05:32:10.832663 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 19/37] 10.222.0.18 () {60 vars in 1292 bytes} [Mon Aug 22 05:32:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:32:11.926485 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-a235a851-2e26-4f7c-a037-d8b0cf591d59 admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:11.927500 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-a235a851-2e26-4f7c-a037-d8b0cf591d59 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 22 05:32:11.927932 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 19/38] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 22 05:32:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:32:12.469848 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-85b5bde7-964b-467f-b413-eb386646275c admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:12.477008 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.wsgi [None req-85b5bde7-964b-467f-b413-eb386646275c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-85b5bde7-964b-467f-b413-eb386646275c admin admin] Request method failure captured: Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Accept: application/json Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Accept-Encoding: gzip, deflate Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Connection: keep-alive Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Content-Length: 0 Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Host: 10.222.0.18 Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Openstack-Api-Version: compute 2.90 Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Openstack-System-Scope: None Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: User-Agent: python-novaclient Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Auth-Token: gAAAAABjAxTbC_zDZnCy8pwFf11Qycj3pTsm06FanFognKld4L_m5Ry-zOqd1A6wTYbt10RGfX5TQmNMhJlbETrmUHWa8vCOW0rc6--5kAqiGbfFZOmWhcQXF970IUlRumVqIhD-5VKEvtiP6_oeU_giplIoRwC3PGZzoyRMJMjCVP-h_REmR0k Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Domain-Id: None Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Domain-Name: None Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Identity-Status: Confirmed Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Is-Admin-Project: True Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Project-Domain-Id: default Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Project-Domain-Name: Default Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Project-Id: fb2b2de175ff44f7b8683cb1604be1f7 Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Project-Name: admin Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Role: admin,member,reader Aug 22 05:32:12.480464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Roles: admin,member,reader Aug 22 05:32:12.482075 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb2b2de175ff44f7b8683cb1604be1f7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:32:12.482075 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Tenant: admin Aug 22 05:32:12.482075 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Tenant-Id: fb2b2de175ff44f7b8683cb1604be1f7 Aug 22 05:32:12.482075 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Tenant-Name: admin Aug 22 05:32:12.482075 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-User: admin Aug 22 05:32:12.482075 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-User-Domain-Id: default Aug 22 05:32:12.482075 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-User-Domain-Name: Default Aug 22 05:32:12.482075 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-User-Id: c35278cad6234455851a9ea018219e84 Aug 22 05:32:12.482075 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-User-Name: admin Aug 22 05:32:12.482075 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: method: > Aug 22 05:32:12.482075 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: exception: Flavor 42 could not be found. Aug 22 05:32:12.482075 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: action_args: {'id': '42'} Aug 22 05:32:12.482075 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:32:12.482075 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:32:12.483081 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Aug 22 05:32:12.484533 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-85b5bde7-964b-467f-b413-eb386646275c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:32:12.485814 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-85b5bde7-964b-467f-b413-eb386646275c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.411226 Aug 22 05:32:12.485814 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 20/39] 10.222.0.18 () {60 vars in 1190 bytes} [Mon Aug 22 05:32:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 05:32:12.492642 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-697973d9-1d50-47b1-962a-2cb6c2b60867 admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:12.496918 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG dbcounter [-] [105766] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:12.517213 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-697973d9-1d50-47b1-962a-2cb6c2b60867 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027686 Aug 22 05:32:12.517429 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 20/40] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Aug 22 05:32:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:32:12.527438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-080759e9-2862-4df2-8ae8-d6dbca2c14f7 admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:12.553262 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-080759e9-2862-4df2-8ae8-d6dbca2c14f7 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029356 Aug 22 05:32:12.553833 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 21/41] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Aug 22 05:32:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 05:32:12.565249 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-e40a4a10-8417-4dbd-99fd-bfcb53f5839a admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:12.572258 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.wsgi [None req-e40a4a10-8417-4dbd-99fd-bfcb53f5839a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-e40a4a10-8417-4dbd-99fd-bfcb53f5839a admin admin] Request method failure captured: Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Accept: application/json Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Accept-Encoding: gzip, deflate Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Connection: keep-alive Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Content-Length: 0 Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Host: 10.222.0.18 Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Openstack-Api-Version: compute 2.90 Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Openstack-System-Scope: None Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: User-Agent: python-novaclient Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Auth-Token: gAAAAABjAxTbC_zDZnCy8pwFf11Qycj3pTsm06FanFognKld4L_m5Ry-zOqd1A6wTYbt10RGfX5TQmNMhJlbETrmUHWa8vCOW0rc6--5kAqiGbfFZOmWhcQXF970IUlRumVqIhD-5VKEvtiP6_oeU_giplIoRwC3PGZzoyRMJMjCVP-h_REmR0k Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Domain-Id: None Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Domain-Name: None Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Identity-Status: Confirmed Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Is-Admin-Project: True Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Project-Domain-Id: default Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Project-Domain-Name: Default Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Project-Id: fb2b2de175ff44f7b8683cb1604be1f7 Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Project-Name: admin Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Role: admin,member,reader Aug 22 05:32:12.575460 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Roles: admin,member,reader Aug 22 05:32:12.576758 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb2b2de175ff44f7b8683cb1604be1f7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:32:12.576758 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Tenant: admin Aug 22 05:32:12.576758 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Tenant-Id: fb2b2de175ff44f7b8683cb1604be1f7 Aug 22 05:32:12.576758 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Tenant-Name: admin Aug 22 05:32:12.576758 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-User: admin Aug 22 05:32:12.576758 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-User-Domain-Id: default Aug 22 05:32:12.576758 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-User-Domain-Name: Default Aug 22 05:32:12.576758 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-User-Id: c35278cad6234455851a9ea018219e84 Aug 22 05:32:12.576758 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-User-Name: admin Aug 22 05:32:12.576758 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: method: > Aug 22 05:32:12.576758 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: exception: Flavor 42 could not be found. Aug 22 05:32:12.576758 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: action_args: {'id': '42'} Aug 22 05:32:12.576758 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:32:12.576758 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:32:12.577544 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Aug 22 05:32:12.578621 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-e40a4a10-8417-4dbd-99fd-bfcb53f5839a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:32:12.579825 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-e40a4a10-8417-4dbd-99fd-bfcb53f5839a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016915 Aug 22 05:32:12.579825 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 21/42] 10.222.0.18 () {60 vars in 1190 bytes} [Mon Aug 22 05:32:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 05:32:13.564611 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-080759e9-2862-4df2-8ae8-d6dbca2c14f7 admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:13.565685 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-080759e9-2862-4df2-8ae8-d6dbca2c14f7 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Aug 22 05:32:13.566320 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 22/43] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 22 05:32:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:32:14.107349 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-efab0a20-659a-4f49-9678-e2ac69e18579 admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:14.113609 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.wsgi [None req-efab0a20-659a-4f49-9678-e2ac69e18579 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-efab0a20-659a-4f49-9678-e2ac69e18579 admin admin] Request method failure captured: Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Accept: application/json Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Accept-Encoding: gzip, deflate Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Connection: keep-alive Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Content-Length: 0 Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Host: 10.222.0.18 Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Openstack-Api-Version: compute 2.90 Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Openstack-System-Scope: None Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: User-Agent: python-novaclient Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Auth-Token: gAAAAABjAxTdeyNats3CFiCtn08z97Pl-HjZLlDab9cLDRKLmgvo2lGjQWmcvxAXDYHEgzwLw8sRLRHmj-669BQyVgPfS_VTnE0QW1TtEPoymDpRkquGu2U-xg41fEmFad41OgMr7uehyIWn6UjeJGBXjxQBIdeOAi3fbnFG8BKTQcbReBae5sE Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Domain-Id: None Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Domain-Name: None Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Identity-Status: Confirmed Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Is-Admin-Project: True Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Project-Domain-Id: default Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Project-Domain-Name: Default Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Project-Id: fb2b2de175ff44f7b8683cb1604be1f7 Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Project-Name: admin Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Role: admin,member,reader Aug 22 05:32:14.115127 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Roles: admin,member,reader Aug 22 05:32:14.116469 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb2b2de175ff44f7b8683cb1604be1f7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:32:14.116469 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Tenant: admin Aug 22 05:32:14.116469 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Tenant-Id: fb2b2de175ff44f7b8683cb1604be1f7 Aug 22 05:32:14.116469 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Tenant-Name: admin Aug 22 05:32:14.116469 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-User: admin Aug 22 05:32:14.116469 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-User-Domain-Id: default Aug 22 05:32:14.116469 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-User-Domain-Name: Default Aug 22 05:32:14.116469 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-User-Id: c35278cad6234455851a9ea018219e84 Aug 22 05:32:14.116469 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-User-Name: admin Aug 22 05:32:14.116469 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: method: > Aug 22 05:32:14.116469 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: exception: Flavor 84 could not be found. Aug 22 05:32:14.116469 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: action_args: {'id': '84'} Aug 22 05:32:14.116469 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:32:14.116469 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:32:14.117292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Aug 22 05:32:14.118534 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-efab0a20-659a-4f49-9678-e2ac69e18579 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:32:14.119531 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-efab0a20-659a-4f49-9678-e2ac69e18579 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.411523 Aug 22 05:32:14.119531 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1190 bytes} [Mon Aug 22 05:32:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 05:32:14.126508 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-13ad4986-304f-4861-9f39-1c27607cfd69 admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:14.142350 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-13ad4986-304f-4861-9f39-1c27607cfd69 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019595 Aug 22 05:32:14.143616 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Aug 22 05:32:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:32:14.153049 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-e4a58085-75d9-4628-be72-d97afa5a733c admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:14.168296 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-e4a58085-75d9-4628-be72-d97afa5a733c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018821 Aug 22 05:32:14.168825 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Aug 22 05:32:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:32:14.178586 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-1261c962-1260-42d4-a061-0b067a0f5f6c admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:14.185355 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.wsgi [None req-1261c962-1260-42d4-a061-0b067a0f5f6c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-1261c962-1260-42d4-a061-0b067a0f5f6c admin admin] Request method failure captured: Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Accept: application/json Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Accept-Encoding: gzip, deflate Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Connection: keep-alive Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Content-Length: 0 Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Host: 10.222.0.18 Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Openstack-Api-Version: compute 2.90 Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Openstack-System-Scope: None Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: User-Agent: python-novaclient Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Auth-Token: gAAAAABjAxTdeyNats3CFiCtn08z97Pl-HjZLlDab9cLDRKLmgvo2lGjQWmcvxAXDYHEgzwLw8sRLRHmj-669BQyVgPfS_VTnE0QW1TtEPoymDpRkquGu2U-xg41fEmFad41OgMr7uehyIWn6UjeJGBXjxQBIdeOAi3fbnFG8BKTQcbReBae5sE Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Domain-Id: None Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Domain-Name: None Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Identity-Status: Confirmed Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Is-Admin-Project: True Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Project-Domain-Id: default Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Project-Domain-Name: Default Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Project-Id: fb2b2de175ff44f7b8683cb1604be1f7 Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Project-Name: admin Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Role: admin,member,reader Aug 22 05:32:14.186918 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Roles: admin,member,reader Aug 22 05:32:14.188247 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb2b2de175ff44f7b8683cb1604be1f7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:32:14.188247 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Tenant: admin Aug 22 05:32:14.188247 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Tenant-Id: fb2b2de175ff44f7b8683cb1604be1f7 Aug 22 05:32:14.188247 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Tenant-Name: admin Aug 22 05:32:14.188247 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-User: admin Aug 22 05:32:14.188247 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-User-Domain-Id: default Aug 22 05:32:14.188247 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-User-Domain-Name: Default Aug 22 05:32:14.188247 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-User-Id: c35278cad6234455851a9ea018219e84 Aug 22 05:32:14.188247 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-User-Name: admin Aug 22 05:32:14.188247 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: method: > Aug 22 05:32:14.188247 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: exception: Flavor 84 could not be found. Aug 22 05:32:14.188247 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: action_args: {'id': '84'} Aug 22 05:32:14.188247 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:32:14.188247 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:32:14.189035 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Aug 22 05:32:14.191438 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-1261c962-1260-42d4-a061-0b067a0f5f6c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:32:14.192866 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-1261c962-1260-42d4-a061-0b067a0f5f6c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013736 Aug 22 05:32:14.195907 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 24/47] 10.222.0.18 () {60 vars in 1190 bytes} [Mon Aug 22 05:32:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 05:32:15.173436 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-e4a58085-75d9-4628-be72-d97afa5a733c admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:15.174508 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-e4a58085-75d9-4628-be72-d97afa5a733c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 22 05:32:15.175013 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 24/48] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 22 05:32:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:32:15.737710 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-7a468b29-37e8-4e08-b4c0-4121fa1a9e82 admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:15.743994 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.wsgi [None req-7a468b29-37e8-4e08-b4c0-4121fa1a9e82 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-7a468b29-37e8-4e08-b4c0-4121fa1a9e82 admin admin] Request method failure captured: Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Accept: application/json Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Accept-Encoding: gzip, deflate Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Connection: keep-alive Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Content-Length: 0 Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Host: 10.222.0.18 Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Openstack-Api-Version: compute 2.90 Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Openstack-System-Scope: None Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: User-Agent: python-novaclient Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Auth-Token: gAAAAABjAxTfBa4vyfD3yLodnAD1JkxVaVwenbMDGWXglmpT9fcPgZz-2Do_x-htHhSM3NYiD0fe_vSwzUlihiLlGTB9c_AnZZStRWNtMCbRSSlSDrS0LSef-1BsIlNSpePBTeqAhIO0io6Boe-GXPU31u6Im8gdsiUstJLG5kllL5WFtywXiTw Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Domain-Id: None Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Domain-Name: None Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Identity-Status: Confirmed Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Is-Admin-Project: True Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Project-Domain-Id: default Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Project-Domain-Name: Default Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Project-Id: fb2b2de175ff44f7b8683cb1604be1f7 Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Project-Name: admin Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Role: admin,member,reader Aug 22 05:32:15.745605 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Roles: admin,member,reader Aug 22 05:32:15.747133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb2b2de175ff44f7b8683cb1604be1f7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:32:15.747133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Tenant: admin Aug 22 05:32:15.747133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Tenant-Id: fb2b2de175ff44f7b8683cb1604be1f7 Aug 22 05:32:15.747133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-Tenant-Name: admin Aug 22 05:32:15.747133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-User: admin Aug 22 05:32:15.747133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-User-Domain-Id: default Aug 22 05:32:15.747133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-User-Domain-Name: Default Aug 22 05:32:15.747133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-User-Id: c35278cad6234455851a9ea018219e84 Aug 22 05:32:15.747133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: X-User-Name: admin Aug 22 05:32:15.747133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: method: > Aug 22 05:32:15.747133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: exception: Flavor 451 could not be found. Aug 22 05:32:15.747133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: action_args: {'id': '451'} Aug 22 05:32:15.747133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:32:15.747133 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:32:15.748334 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: ERROR nova.api.openstack.wsgi Aug 22 05:32:15.749636 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-7a468b29-37e8-4e08-b4c0-4121fa1a9e82 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:32:15.750886 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-7a468b29-37e8-4e08-b4c0-4121fa1a9e82 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.434489 Aug 22 05:32:15.750886 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 25/49] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Aug 22 05:32:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 05:32:15.756993 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-2066a977-31ef-4894-a9a0-10484db8aab1 admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:15.772090 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-2066a977-31ef-4894-a9a0-10484db8aab1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018657 Aug 22 05:32:15.772616 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 25/50] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Aug 22 05:32:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:32:15.782222 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-6eba4227-fb0c-4bb7-bb90-4fbba953b17c admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:15.797489 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-6eba4227-fb0c-4bb7-bb90-4fbba953b17c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018809 Aug 22 05:32:15.798022 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 26/51] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Aug 22 05:32:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:32:15.807274 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-d39e117d-9174-4245-8d07-b20034b23127 admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:15.813045 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.wsgi [None req-d39e117d-9174-4245-8d07-b20034b23127 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-d39e117d-9174-4245-8d07-b20034b23127 admin admin] Request method failure captured: Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Accept: application/json Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Accept-Encoding: gzip, deflate Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Connection: keep-alive Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Content-Length: 0 Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Host: 10.222.0.18 Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Openstack-Api-Version: compute 2.90 Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Openstack-System-Scope: None Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: User-Agent: python-novaclient Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Auth-Token: gAAAAABjAxTfBa4vyfD3yLodnAD1JkxVaVwenbMDGWXglmpT9fcPgZz-2Do_x-htHhSM3NYiD0fe_vSwzUlihiLlGTB9c_AnZZStRWNtMCbRSSlSDrS0LSef-1BsIlNSpePBTeqAhIO0io6Boe-GXPU31u6Im8gdsiUstJLG5kllL5WFtywXiTw Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Domain-Id: None Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Domain-Name: None Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Identity-Status: Confirmed Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Is-Admin-Project: True Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Project-Domain-Id: default Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Project-Domain-Name: Default Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Project-Id: fb2b2de175ff44f7b8683cb1604be1f7 Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Project-Name: admin Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Role: admin,member,reader Aug 22 05:32:15.814517 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Roles: admin,member,reader Aug 22 05:32:15.816520 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb2b2de175ff44f7b8683cb1604be1f7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb2b2de175ff44f7b8683cb1604be1f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:32:15.816520 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Tenant: admin Aug 22 05:32:15.816520 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Tenant-Id: fb2b2de175ff44f7b8683cb1604be1f7 Aug 22 05:32:15.816520 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-Tenant-Name: admin Aug 22 05:32:15.816520 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-User: admin Aug 22 05:32:15.816520 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-User-Domain-Id: default Aug 22 05:32:15.816520 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-User-Domain-Name: Default Aug 22 05:32:15.816520 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-User-Id: c35278cad6234455851a9ea018219e84 Aug 22 05:32:15.816520 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: X-User-Name: admin Aug 22 05:32:15.816520 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: method: > Aug 22 05:32:15.816520 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: exception: Flavor 451 could not be found. Aug 22 05:32:15.816520 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: action_args: {'id': '451'} Aug 22 05:32:15.816520 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:32:15.816520 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:32:15.817489 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: ERROR nova.api.openstack.wsgi Aug 22 05:32:15.818770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-d39e117d-9174-4245-8d07-b20034b23127 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:32:15.820020 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-d39e117d-9174-4245-8d07-b20034b23127 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012264 Aug 22 05:32:15.820020 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 26/52] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Aug 22 05:32:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 05:32:16.805103 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-6eba4227-fb0c-4bb7-bb90-4fbba953b17c admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:16.806496 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-6eba4227-fb0c-4bb7-bb90-4fbba953b17c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 Aug 22 05:32:16.806901 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 22 05:32:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:32:17.381269 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-f314cd38-e0a3-4942-9c3a-5651d167031d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:32:17.403343 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-f314cd38-e0a3-4942-9c3a-5651d167031d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.460772 Aug 22 05:32:17.403924 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 27/54] 10.222.0.18 () {64 vars in 1235 bytes} [Mon Aug 22 05:32:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:32:18.397813 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-6eba4227-fb0c-4bb7-bb90-4fbba953b17c admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:18.398800 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-6eba4227-fb0c-4bb7-bb90-4fbba953b17c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 22 05:32:18.399198 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 22 05:32:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:32:18.986980 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-7cc39ad6-e1ef-4713-b4dd-5116a90e5078 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:32:19.013315 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-7cc39ad6-e1ef-4713-b4dd-5116a90e5078 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.473287 Aug 22 05:32:19.014110 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 28/56] 10.222.0.18 () {64 vars in 1235 bytes} [Mon Aug 22 05:32:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:32:20.031464 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-6eba4227-fb0c-4bb7-bb90-4fbba953b17c admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:20.032499 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-6eba4227-fb0c-4bb7-bb90-4fbba953b17c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 22 05:32:20.032901 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 29/57] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 22 05:32:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:32:20.613934 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-6d5de2f4-e772-4bed-8c07-f1470adfc9c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:32:20.636479 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-6d5de2f4-e772-4bed-8c07-f1470adfc9c2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.461088 Aug 22 05:32:20.637066 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 29/58] 10.222.0.18 () {64 vars in 1235 bytes} [Mon Aug 22 05:32:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:32:21.642022 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-6eba4227-fb0c-4bb7-bb90-4fbba953b17c admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:21.643842 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-6eba4227-fb0c-4bb7-bb90-4fbba953b17c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002214 Aug 22 05:32:21.644246 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 30/59] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 22 05:32:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:32:22.231437 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-5bb6a46a-ca0c-4d9f-94f7-e84bc21d910d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:32:22.258600 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-5bb6a46a-ca0c-4d9f-94f7-e84bc21d910d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.477412 Aug 22 05:32:22.259149 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 30/60] 10.222.0.18 () {64 vars in 1235 bytes} [Mon Aug 22 05:32:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 05:32:23.247754 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-6eba4227-fb0c-4bb7-bb90-4fbba953b17c admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:23.248753 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-6eba4227-fb0c-4bb7-bb90-4fbba953b17c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 22 05:32:23.249143 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 31/61] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 22 05:32:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:32:23.799742 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-5166760c-877c-4053-8d8b-6d9caea52118 admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:32:23.820018 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-5166760c-877c-4053-8d8b-6d9caea52118 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.432864 Aug 22 05:32:23.820552 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 31/62] 10.222.0.18 () {60 vars in 1202 bytes} [Mon Aug 22 05:32:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:33:18.119762 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-6eba4227-fb0c-4bb7-bb90-4fbba953b17c admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:33:18.120773 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-6eba4227-fb0c-4bb7-bb90-4fbba953b17c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 22 05:33:18.121203 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 32/63] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 22 05:33:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:33:18.136111 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG dbcounter [-] [105766] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:18.559666 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-0dfe48b4-7204-486c-9106-15ba12b093dc admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:33:18.580782 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-0dfe48b4-7204-486c-9106-15ba12b093dc admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.452858 Aug 22 05:33:18.581294 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 32/64] 10.222.0.18 () {60 vars in 1292 bytes} [Mon Aug 22 05:33:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:33:18.605793 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG dbcounter [-] [105765] Writing DB stats nova_api:SELECT=14 {{(pid=105765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:18.611402 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-70207622-1dcc-4a00-b4c4-a610c78d8c4a admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:33:18.620839 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-70207622-1dcc-4a00-b4c4-a610c78d8c4a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017263 Aug 22 05:33:18.621899 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 33/65] 10.222.0.18 () {60 vars in 1283 bytes} [Mon Aug 22 05:33:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:33:18.636049 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-f5d15294-a76c-4ae9-9ede-f2e90e99c0e7 admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:33:18.644138 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-f5d15294-a76c-4ae9-9ede-f2e90e99c0e7 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011834 Aug 22 05:33:18.644663 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 33/66] 10.222.0.18 () {60 vars in 1286 bytes} [Mon Aug 22 05:33:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:33:18.656392 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-cc3d4596-fbea-43e5-9048-a05f47699ca3 admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:33:18.664532 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-cc3d4596-fbea-43e5-9048-a05f47699ca3 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011781 Aug 22 05:33:18.665049 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 34/67] 10.222.0.18 () {60 vars in 1286 bytes} [Mon Aug 22 05:33:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:33:18.676389 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-cf8aab5e-bd1c-4ac6-9257-e83cbf0965a0 admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:33:18.684226 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-cf8aab5e-bd1c-4ac6-9257-e83cbf0965a0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011374 Aug 22 05:33:18.684676 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 34/68] 10.222.0.18 () {60 vars in 1283 bytes} [Mon Aug 22 05:33:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:36:15.142439 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-cc3d4596-fbea-43e5-9048-a05f47699ca3 admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:36:15.143475 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-cc3d4596-fbea-43e5-9048-a05f47699ca3 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 22 05:36:15.143909 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 35/69] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 22 05:36:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:36:15.283898 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG dbcounter [-] [105766] Writing DB stats nova_api:SELECT=6 {{(pid=105766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:36:15.473301 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-b80aa2cb-5fdd-4ad8-96ea-c385bebb0c87 admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:36:15.475672 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:36:15.475672 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: warnings.warn(msg) Aug 22 05:36:15.476780 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-b80aa2cb-5fdd-4ad8-96ea-c385bebb0c87 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:36:15.477552 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-b80aa2cb-5fdd-4ad8-96ea-c385bebb0c87 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:36:15.477975 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-b80aa2cb-5fdd-4ad8-96ea-c385bebb0c87 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:36:15.478678 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-b80aa2cb-5fdd-4ad8-96ea-c385bebb0c87 admin admin] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:36:15.479112 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-b80aa2cb-5fdd-4ad8-96ea-c385bebb0c87 admin admin] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:36:15.479514 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-b80aa2cb-5fdd-4ad8-96ea-c385bebb0c87 admin admin] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:36:15.512942 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-b80aa2cb-5fdd-4ad8-96ea-c385bebb0c87 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.230423 Aug 22 05:36:15.513422 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 35/70] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Aug 22 05:36:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:36:16.376114 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-cc3d4596-fbea-43e5-9048-a05f47699ca3 admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:36:16.377124 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-cc3d4596-fbea-43e5-9048-a05f47699ca3 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 22 05:36:16.377526 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 22 05:36:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:36:16.585282 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-a96cf886-6d9d-4060-ab81-4d5ccc70999c admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:36:16.589292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:36:16.589292 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: warnings.warn(msg) Aug 22 05:36:16.590928 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-a96cf886-6d9d-4060-ab81-4d5ccc70999c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:36:16.591644 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-a96cf886-6d9d-4060-ab81-4d5ccc70999c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:36:16.592237 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-a96cf886-6d9d-4060-ab81-4d5ccc70999c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:36:16.593297 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-a96cf886-6d9d-4060-ab81-4d5ccc70999c admin admin] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:36:16.593918 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-a96cf886-6d9d-4060-ab81-4d5ccc70999c admin admin] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:36:16.594895 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-a96cf886-6d9d-4060-ab81-4d5ccc70999c admin admin] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:36:16.617032 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-a96cf886-6d9d-4060-ab81-4d5ccc70999c admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.101858 Aug 22 05:36:16.617609 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 36/72] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Aug 22 05:36:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:36:27.877669 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-cc3d4596-fbea-43e5-9048-a05f47699ca3 admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:36:27.879013 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-cc3d4596-fbea-43e5-9048-a05f47699ca3 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001949 Aug 22 05:36:27.879539 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 22 05:36:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:36:28.019554 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG dbcounter [-] [105766] Writing DB stats nova_cell0:SELECT=4 {{(pid=105766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:36:28.020274 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG dbcounter [-] [105766] Writing DB stats nova_cell1:SELECT=4 {{(pid=105766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:36:28.020864 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG dbcounter [-] [105766] Writing DB stats nova_api:SELECT=8 {{(pid=105766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:36:28.077490 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-7f9cd619-45c9-4c68-97dd-8c8047ce0973 admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:36:28.079867 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:36:28.079867 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: warnings.warn(msg) Aug 22 05:36:28.081004 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-7f9cd619-45c9-4c68-97dd-8c8047ce0973 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:36:28.081483 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-7f9cd619-45c9-4c68-97dd-8c8047ce0973 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:36:28.081909 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-7f9cd619-45c9-4c68-97dd-8c8047ce0973 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:36:28.082617 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-7f9cd619-45c9-4c68-97dd-8c8047ce0973 admin admin] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:36:28.083060 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-7f9cd619-45c9-4c68-97dd-8c8047ce0973 admin admin] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:36:28.083473 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-7f9cd619-45c9-4c68-97dd-8c8047ce0973 admin admin] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:36:28.108465 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-7f9cd619-45c9-4c68-97dd-8c8047ce0973 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.093338 Aug 22 05:36:28.109011 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 37/74] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Aug 22 05:36:28 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:36:28.945000 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: DEBUG nova.api.openstack.wsgi [None req-cc3d4596-fbea-43e5-9048-a05f47699ca3 admin admin] Calling method '>' {{(pid=105765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:36:28.946008 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: INFO nova.api.openstack.requestlog [None req-cc3d4596-fbea-43e5-9048-a05f47699ca3 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 22 05:36:28.946414 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: [pid: 105765|app: 0|req: 38/75] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 22 05:36:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:36:29.145320 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG nova.api.openstack.wsgi [None req-0a785964-9db6-4337-b6e8-1a8e89394b49 admin admin] Calling method '>' {{(pid=105766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:36:29.147784 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:36:29.147784 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: warnings.warn(msg) Aug 22 05:36:29.148883 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-0a785964-9db6-4337-b6e8-1a8e89394b49 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:36:29.149349 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-0a785964-9db6-4337-b6e8-1a8e89394b49 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:36:29.149770 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-0a785964-9db6-4337-b6e8-1a8e89394b49 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:36:29.150481 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-0a785964-9db6-4337-b6e8-1a8e89394b49 admin admin] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:36:29.150919 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-0a785964-9db6-4337-b6e8-1a8e89394b49 admin admin] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:36:29.151328 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: DEBUG oslo_concurrency.lockutils [None req-0a785964-9db6-4337-b6e8-1a8e89394b49 admin admin] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:36:29.174204 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: INFO nova.api.openstack.requestlog [None req-0a785964-9db6-4337-b6e8-1a8e89394b49 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090211 Aug 22 05:36:29.174751 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: [pid: 105766|app: 0|req: 38/76] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Aug 22 05:36:29 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:37:26.175658 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: Mon Aug 22 05:37:26 2022 - graceful shutdown triggered... Aug 22 05:37:26.176313 dv-cinder-853910-1-iscsi devstack@n-api.service[105765]: Gracefully killing worker 1 (pid: 105765)... Aug 22 05:37:26.176767 dv-cinder-853910-1-iscsi devstack@n-api.service[105766]: Gracefully killing worker 2 (pid: 105766)... Aug 22 05:37:26.177853 dv-cinder-853910-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 22 05:37:27.177508 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: worker 1 buried after 1 seconds Aug 22 05:37:27.177508 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: worker 2 buried after 1 seconds Aug 22 05:37:27.177508 dv-cinder-853910-1-iscsi devstack@n-api.service[105764]: goodbye to uWSGI. Aug 22 05:37:27.179655 dv-cinder-853910-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 22 05:37:27.180266 dv-cinder-853910-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 22 05:37:27.183638 dv-cinder-853910-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 22 05:37:27.195344 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 22 05:37:27.197717 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 05:37:27 2022] *** Aug 22 05:37:27.197717 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 05:37:27.197717 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 05:37:27.197717 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: nodename: dv-cinder-853910-1-iscsi Aug 22 05:37:27.197717 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: machine: x86_64 Aug 22 05:37:27.197717 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: clock source: unix Aug 22 05:37:27.197717 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: pcre jit disabled Aug 22 05:37:27.197717 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: detected number of CPU cores: 4 Aug 22 05:37:27.197717 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: current working directory: / Aug 22 05:37:27.197717 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: detected binary path: /usr/bin/uwsgi-core Aug 22 05:37:27.197717 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: your processes number limit is 47680 Aug 22 05:37:27.198652 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: your memory page size is 4096 bytes Aug 22 05:37:27.198652 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: detected max file descriptor number: 2048 Aug 22 05:37:27.198652 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: lock engine: pthread robust mutexes Aug 22 05:37:27.198652 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: thunder lock: enabled Aug 22 05:37:27.198652 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 22 05:37:27.198652 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 05:37:27.239979 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: Python main interpreter initialized at 0x55e697b559c0 Aug 22 05:37:27.239979 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: python threads support enabled Aug 22 05:37:27.239979 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: your server socket listen backlog is limited to 100 connections Aug 22 05:37:27.239979 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: your mercy for graceful operations on workers is 90 seconds Aug 22 05:37:27.240424 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 05:37:27.240424 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: *** Operational MODE: preforking *** Aug 22 05:37:27.240695 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: *** uWSGI is running in multiple interpreter mode *** Aug 22 05:37:27.240695 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: spawned uWSGI master process (pid: 132479) Aug 22 05:37:27.240965 dv-cinder-853910-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 22 05:37:27.243626 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: spawned uWSGI worker 1 (pid: 132497, cores: 1) Aug 22 05:37:27.243626 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: spawned uWSGI worker 2 (pid: 132498, cores: 1) Aug 22 05:37:27.243626 dv-cinder-853910-1-iscsi devstack@n-api.service[132479]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 05:37:27.910946 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 05:37:27.911458 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 05:37:29.071541 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 05:37:29.071541 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: from cryptography.utils import int_from_bytes Aug 22 05:37:29.072254 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 05:37:29.072254 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: from cryptography.utils import int_from_bytes Aug 22 05:37:29.100568 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 05:37:29.100568 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: from cryptography.utils import int_from_bytes Aug 22 05:37:29.101179 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 05:37:29.101179 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: from cryptography.utils import int_from_bytes Aug 22 05:37:31.487865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 05:37:31.488920 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 05:37:31.489753 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 05:37:31.490508 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 05:37:31.491249 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 05:37:31.492276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.493171 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.493898 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.494441 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.495175 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.495731 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.496281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.496931 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.497490 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.498077 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.498620 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.499258 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-1-iscsi {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.499825 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.500369 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.500897 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.501431 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.501939 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.502481 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.503018 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.503999 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.505379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.505909 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.506364 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.507141 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.507479 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.507862 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.508312 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.508755 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.509217 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.509663 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.510273 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-1-iscsi {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.510719 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.511311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.511657 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.512095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.512419 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.512761 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.513102 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.513778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.514162 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.514739 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.515070 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.515395 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.515742 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.516053 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.516369 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.516712 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.517212 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.517498 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.517806 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.518058 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.518370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.518693 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.519024 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.519349 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.519620 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.519873 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.520191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.520509 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.520820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.521143 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.521588 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.521901 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.522210 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.522517 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.522824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.523130 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.523451 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.523987 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.524318 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.524626 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.525147 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.525556 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.525814 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.526115 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.526457 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.526781 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.527113 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.527436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.527782 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.528096 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.528397 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.528727 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.529105 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.529440 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.529745 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.529994 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.530297 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.530610 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.530928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.531236 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.531720 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.532036 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.532337 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.532646 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.532952 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.533270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.533569 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.533876 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.534374 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.534688 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.535082 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.535388 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.535743 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.536061 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.536370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.536676 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.536980 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.537286 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.537608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.537910 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.538214 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.538538 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.538848 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.539150 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.539469 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.539801 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.540109 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.540424 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.540723 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.541029 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.541346 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.541803 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.542116 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.542421 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.542726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.543029 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.543334 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.543668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.543974 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.544299 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.544626 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.545085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.545402 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.545708 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.546015 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.546332 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.546674 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.547004 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.547348 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.547688 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.548023 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.548356 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.548679 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.548990 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.549306 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.549631 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.549945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.550255 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.550568 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.550887 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.551207 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.551535 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.552006 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.552327 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.552646 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.552958 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.553277 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.553604 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.553928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.554238 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.554577 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.554922 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.555310 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.555662 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.555987 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.556301 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.556627 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.556931 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.557247 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.557592 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.557907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.558226 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.558549 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.558860 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.559378 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.559724 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.560041 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.560386 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.561217 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.561617 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.562081 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.562407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.562724 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.563040 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.563354 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.563689 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.563987 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.564296 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.564609 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.564911 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.565310 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.565653 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.565962 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.566298 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.566604 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.566915 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.567227 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.567535 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.567862 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.568180 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.568498 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.568802 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.569130 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.569442 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.569747 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.570074 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.570731 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.571041 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.571364 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.571700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.572056 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.572355 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.572668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.572996 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.573580 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.573910 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.574241 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.574572 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.574877 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.575225 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.575559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.576030 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.576512 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.576866 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.577174 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.577479 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.577781 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.578091 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.578402 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.578710 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.579008 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.579318 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.579662 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.579969 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.580280 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.580585 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.580889 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.581192 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.581538 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.581847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.582191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.582531 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.582855 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.583176 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.583491 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.583832 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.584145 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.584460 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.584771 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.585085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.585405 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.585722 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.586042 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.586363 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.586673 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.586983 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.587301 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.587670 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.587968 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.588312 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.588644 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.588965 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.589285 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.589597 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.589945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.590256 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.590567 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.590878 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.591194 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.593574 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.594283 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.594618 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.594934 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.595265 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.595601 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.595922 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.596231 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.596545 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.596883 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.597217 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.597528 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.597843 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.598166 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.598478 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.598789 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.599100 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.599256 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 05:37:31.599780 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.599925 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 05:37:31.600076 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.600233 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 05:37:31.600375 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.600524 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 05:37:31.600673 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.600813 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 05:37:31.600961 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.601126 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.601275 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.601275 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.601551 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.601691 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.601839 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.601988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.602137 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.602277 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.602424 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.602574 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.602884 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.603143 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.603308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.603450 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.603645 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.603798 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.603950 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.604107 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.604256 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.604406 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.604555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.604776 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.604926 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-1-iscsi {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.605082 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.605224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.605386 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.605575 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.605728 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.605880 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.606034 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.606182 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.606423 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.606577 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.606720 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.606888 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.607236 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.607525 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.607812 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.607812 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.608159 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.608340 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.608491 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.608640 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.608799 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.609021 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.609255 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.609416 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.609559 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.609719 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.609861 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.610010 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.610171 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.610312 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.610459 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.610607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.610755 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.610896 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.611634 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.611789 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.611941 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.612185 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.612185 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.612478 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-1-iscsi {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.612620 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.612769 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.613071 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.613331 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.613484 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.613633 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.613796 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.613962 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.614107 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.614310 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.614453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.614594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.614734 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.614734 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.615130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.615130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.615407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.615619 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.615777 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.615935 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.616075 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.616215 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.616369 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.616639 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.616800 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.616942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.617108 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.617345 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.617515 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.617750 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.617903 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.618052 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.618207 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.618356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.618534 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.618684 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.618832 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.618973 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.619206 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.619462 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.619627 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.619774 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.619924 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.620065 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.620205 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.620353 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.620496 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.620647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.620801 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.620950 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.621102 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.621250 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.621399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.621541 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.621689 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.621844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.621997 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.622146 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.622310 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.622459 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.622601 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.622812 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.623160 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.623336 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.623631 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.623794 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.623937 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.624092 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.624234 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.624331 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.624417 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.624495 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.624586 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.624672 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.624755 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.624834 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.624913 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.625003 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.625076 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.625160 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.625239 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.625311 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.625388 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.625388 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.625523 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.625523 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.625893 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.625893 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.626049 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.626121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.626200 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.626278 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.626356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.626435 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.626435 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.626578 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.626658 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.626744 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.626839 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.626930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.627014 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.627105 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.627214 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.627318 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.627403 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.627528 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.627631 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.627631 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.627821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.628512 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.628634 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.628723 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.628806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.628897 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.628990 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.629082 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.629166 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.629273 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.629356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.629467 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.629554 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.629695 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.629829 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.630002 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.630117 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.630311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.630405 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.630622 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.630731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.630916 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.631017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.631223 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.631322 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.631523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.631637 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.631867 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.631959 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.632179 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.632270 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.632481 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.632572 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.632780 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.632884 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.633093 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.633202 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.633401 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.633515 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.633700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.633814 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.634016 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.634111 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.634326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.634419 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.634625 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.634734 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.634923 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.635017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.635229 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.635336 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.635528 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.635668 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.635851 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.635952 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.636159 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.636265 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.636476 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.636578 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.636785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.636947 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.637083 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.637181 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.637391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.637484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.637697 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.637816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.637993 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.638086 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.638294 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.638437 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.638649 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.638766 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.638949 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.639050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.639249 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.639352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.639549 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.639682 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.639875 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.639977 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.640175 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.640268 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.640479 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.640588 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.640787 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.640886 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.641090 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.641183 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.641392 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.641486 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.641695 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.641798 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.642070 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.642278 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.642384 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.642589 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.642691 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.642972 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.643078 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.643246 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.643353 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.643566 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.643686 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.643918 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.644011 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:37:31.644235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.644341 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.644552 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.644652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.644868 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.644960 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.645173 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.645274 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.645487 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.645579 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.645799 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.645892 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.646111 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.646203 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.646415 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.646514 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.646719 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.646843 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.647039 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.647173 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.647350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.647491 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.647681 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.647845 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.648000 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.648168 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.648322 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.648492 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.648642 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.648898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.649007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.649167 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.649269 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.649554 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.649654 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.650645 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.650762 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.650839 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.650911 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.650911 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.651039 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.651125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.651205 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.651283 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.651356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.651440 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.651521 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.651736 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.651816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.652020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.652116 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.652325 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.652439 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.652637 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.652760 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.652950 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.653091 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.653276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.653456 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.655122 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.655215 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.655215 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.655388 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.655484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.655608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.656573 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.656689 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.656765 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.656836 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.656934 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.657019 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.657099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.657169 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.657239 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.657308 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.657424 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.657532 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.657619 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.657711 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.657850 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.657945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.658033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.658118 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.658397 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.658483 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.658580 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.658664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.658756 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.658849 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.658940 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.659026 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.659117 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.659210 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.659295 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.659377 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.659459 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.659639 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.659795 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.659908 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.660137 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.660235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.660448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.660539 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.660762 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.660946 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.661102 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.661255 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.661409 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.661550 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.661699 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.661854 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.662039 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.662199 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.662350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.662501 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.662649 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.662796 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.662935 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.663073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.663218 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.663355 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.663542 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.663670 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.663873 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.663966 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.664197 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.664295 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.664508 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.664613 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.664822 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.664915 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.665130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.665218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.665459 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.665554 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.665776 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.665869 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.666077 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.666203 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.666390 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.666484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.666700 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.666799 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.667009 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.667115 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.667326 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.667426 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.667660 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.667770 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.667978 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.668080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.668283 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.668393 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.668607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.668719 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.668927 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.669086 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.669243 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.669351 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.669579 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.669731 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.670016 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.670124 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.670337 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.670477 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.670649 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.670796 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.670972 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.671130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.671298 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.671473 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.671619 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.671837 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.671949 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.672150 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.672243 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.672470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.672572 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.672781 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.672885 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.673091 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.673184 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.673399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.673496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.673712 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.673812 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.674022 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.674114 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.674331 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.674625 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.674745 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.674933 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.675033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.675236 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.675332 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.675559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.675755 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.675881 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.675982 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.676204 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.676312 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.676518 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.676682 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.676832 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.676932 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.677149 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.677241 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.677455 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.677555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.677775 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.677883 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.678085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.678188 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.678390 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.678501 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.678691 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.678800 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.678994 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.679088 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.679337 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.679430 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.679670 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.679792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.679993 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.680097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.680322 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.680425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.680651 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.680751 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.680949 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.681066 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.681279 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.681373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.681599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.681690 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.681914 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.682016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.682231 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.682324 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.682546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.682636 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.682845 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.682945 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.683148 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.683250 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.683456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.683549 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.683782 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.683885 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.684083 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.684178 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.684385 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.684486 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.684694 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.684795 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.684992 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.685114 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.685367 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.685483 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.685673 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.685801 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.685993 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.686119 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.686297 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.686439 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.686616 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.686814 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.686915 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.687146 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.687238 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.687464 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.687588 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.687816 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.687919 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.688131 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.688221 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.688444 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.688542 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.688760 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.688850 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.689070 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.689160 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.689380 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.689471 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.689700 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.689808 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.690018 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.690130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.690335 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.690494 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.690636 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.690792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.690937 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.691075 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.691252 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.691390 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.691567 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.691791 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.691931 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.692084 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.692312 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.692450 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.692626 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.692769 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.692926 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.693075 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.693238 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.693558 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.693697 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.693875 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.694012 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.694193 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.694328 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.694502 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.694649 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.694825 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.694981 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.695134 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.695277 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.695416 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.695559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.695753 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.695857 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.696063 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.696162 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.696376 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.696476 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.696687 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.696802 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.697013 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.697114 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.697331 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.697433 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.697640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.697740 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.697948 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.698042 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.698273 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.698374 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.698586 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.698693 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.698896 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.698987 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.699205 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.699298 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.699515 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.699635 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.699888 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.699979 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.700189 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.700281 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.700498 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.700598 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.700828 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.700922 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.701164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.701261 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.701535 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.701627 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.701857 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.701955 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.702175 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.702281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.702500 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.702592 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.702818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.702909 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.703137 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.703243 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.703452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.703555 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.703793 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.703890 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.704115 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.704220 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.704434 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.704526 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.704751 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.704853 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.705064 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.705155 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.705380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.705474 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.705695 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.705785 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.706011 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.706205 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.706320 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.706520 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.706638 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.706851 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.706954 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.707175 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.707498 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.707632 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.707844 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.707951 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.708163 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.708255 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.708490 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.708578 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.708797 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.708903 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.709102 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.709203 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.709417 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.709509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.709729 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.709834 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.710032 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.710123 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.710354 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.710463 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.710664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.710756 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.710968 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.711059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.711288 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.711381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.711614 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.711724 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.711960 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.712225 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.712331 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.712567 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.712666 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.712881 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.712972 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.713187 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.713292 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.713499 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.713591 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.713805 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.713905 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.714113 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.714220 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.714428 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.714519 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.714733 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.714837 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.715038 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.715137 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.715346 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.715436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.715697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.715812 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.716005 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.716104 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.716308 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.716408 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.716649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.716760 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.716952 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.717046 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.717251 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.717351 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.717560 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.717654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.717864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.717965 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.718195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.718288 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.718501 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.718954 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.719164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.719266 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.719471 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.719564 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.719809 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.719911 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.720114 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.720210 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.720416 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.720522 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.720719 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.720811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.721021 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.721122 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.721331 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.721428 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.721634 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.721734 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.721944 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.722036 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.722245 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.722352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.722559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.722651 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.722864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.722956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.723172 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.723277 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.723472 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.723607 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.723805 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.723896 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.724107 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.724202 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.724430 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.724528 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.724745 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.724836 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.725054 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.725153 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.725373 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.725473 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.725682 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.725774 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.725991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.726082 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.726308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.726401 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.726618 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.726711 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.726940 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.727150 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.727252 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.727485 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.727598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.727831 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.727933 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.728165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.728257 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.728480 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.728570 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.728788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.728881 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.729151 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.729256 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.729428 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.729522 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.729738 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.729831 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.730046 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.730147 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.730361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.730448 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.730669 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.730762 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.730977 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.731068 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.731285 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.731385 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.731617 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.731715 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.731931 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.732025 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.732302 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.732446 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.732607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.732851 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.732953 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.733210 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.733400 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.733508 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.733722 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.733815 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.734038 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.734148 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.734356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.734457 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.734669 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.734761 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.734981 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.735073 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.735293 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.735386 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.735623 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.735718 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.735937 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.736028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.736267 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.736368 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.736584 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.736685 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.736891 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.736989 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.737198 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.737300 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.737505 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.737595 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.737832 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.737979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.738146 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.738247 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.738451 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.738543 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.738801 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.738905 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.739122 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.739240 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.739453 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.739557 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.739796 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.739905 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.740113 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.740205 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.740432 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.740522 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.740748 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.740882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.741056 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.741152 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.741377 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.741478 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.741685 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.741787 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.741998 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.742089 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.742306 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.742407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.742631 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.742740 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.742951 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.743064 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.743252 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.743344 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.743554 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.743671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.743877 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.743982 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.744190 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.744297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.744514 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.744627 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.744818 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.744912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.745123 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.745242 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.745429 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.745600 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.745763 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.745936 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.746042 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.746141 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.746310 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.746407 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.746611 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.746705 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.746911 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.747018 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.747215 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.747310 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.747513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.747640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.747906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.748121 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.748224 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.748445 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.748554 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.748763 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.748869 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.749068 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.749161 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.749381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.749495 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.749685 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.749805 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.749984 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.750086 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.750285 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.750377 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.750586 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.750691 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.750890 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.751006 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.751198 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.751290 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.751534 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.751646 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.751873 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.751966 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.752194 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.752294 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.752507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.752609 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.752828 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.752919 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.753136 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.753228 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.753458 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.753558 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.753778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.753879 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.754092 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.754183 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.754403 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.754520 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.754734 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.754844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.755042 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.755143 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.755355 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.755452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.755690 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.755792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.756001 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.756181 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.756313 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.756486 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.756641 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.756794 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.756954 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.757109 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.757260 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.757411 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.757561 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.757701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.757854 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.758011 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.758159 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.758318 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.758453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.758595 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.758749 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.758897 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.759043 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.759183 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.759464 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.759674 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.759910 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.760046 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.760227 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.760322 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.760543 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.760638 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.760873 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.761003 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.761183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.761276 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.761501 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.761603 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.761814 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.761932 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.762136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.762240 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.762448 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.762555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.762764 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.762883 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.763092 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.763198 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.763491 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.763631 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.763839 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.763983 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.764130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.764429 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.764529 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.764773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.764866 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.765100 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.765355 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.765451 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.765792 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.765900 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.766151 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.766265 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.766472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.766742 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.766844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.767096 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.767219 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.767414 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.767544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.767748 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.768014 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.768120 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.768261 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 05:37:31.768356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.768659 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.768986 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.769296 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.769620 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.769938 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.770251 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.770560 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.770868 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.771197 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.771503 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.771863 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.772181 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.772510 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.772838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.773150 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.773475 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.773790 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.774102 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.774411 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.774721 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.775069 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.775377 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.775730 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.776066 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.776401 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.776717 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.777054 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.777385 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.777713 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.778031 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.778360 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.778671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.779040 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.779449 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.779861 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.780175 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.780482 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.780799 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.781108 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.781417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.781724 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.782061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.782370 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.782696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.783013 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.783329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.783657 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.783970 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.784317 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.784626 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.784962 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.785280 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.785606 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.785933 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.786254 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.786576 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.786897 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.787220 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.787544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.787890 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.788205 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.788529 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.788851 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.789199 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.789753 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.790105 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.790416 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.790737 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.791058 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.791382 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.791730 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.792059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.792375 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.792693 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.793010 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.793351 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.793678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.794009 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.794350 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.794795 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.795119 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.795442 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.795791 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.796159 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.796484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.796796 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.797116 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.797438 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.797761 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.798081 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.798401 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.798722 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.799040 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.799358 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.799702 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.800025 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.800342 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.800674 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.801016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.801343 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.801663 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.801991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.802311 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.802833 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.803158 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.803499 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.803856 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.804190 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.804516 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.804840 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.805172 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.805487 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.805798 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.806115 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.806432 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.806741 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.807070 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.807389 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.807724 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.808054 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.808371 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.808984 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.809341 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.809665 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.809996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.810467 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.810799 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.811113 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.811442 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.811779 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.812097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.812419 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.812738 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.813052 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.813362 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.813683 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.813996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.814304 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.814619 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.814929 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.815266 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.815594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.815908 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.816218 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.816539 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.816852 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.817163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.817474 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.817784 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.818101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.818410 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.818729 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.819040 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.819360 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.819695 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.820013 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.820324 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.820653 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.820965 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.821327 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.821650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.821975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.822305 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.822621 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.822941 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.823294 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.823644 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.824185 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.824523 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.824846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.825219 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.825547 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.825919 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.826225 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.826626 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.826965 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.827286 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.827630 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.827953 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.828271 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.828592 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.828909 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.829230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.829547 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.829865 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.830183 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.830532 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.830848 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.830987 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO dbcounter [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] Registered counter for database nova_api Aug 22 05:37:31.831165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.831481 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.831828 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.832179 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.832506 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.832834 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.833159 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.833484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.833770 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.834087 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.834420 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.834735 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.835059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.835431 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.835764 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.836077 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.836509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.836815 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.837142 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.837483 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.837792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.838120 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.838447 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.838769 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.839099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.839418 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.839777 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.840121 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.840454 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.840787 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.841100 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.841415 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.841772 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.842097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.842510 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.842828 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.843139 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.843449 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.844148 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.844458 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.844768 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.845077 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.845384 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.845702 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.846006 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.846761 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.846761 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.847286 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.847384 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.847652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.847969 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.848281 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.848601 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.848898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.849209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.849510 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.849850 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.850190 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.850522 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.850852 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.851187 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.851501 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.851851 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.852177 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.852382 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_db.sqlalchemy.engines [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:37:31.852560 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.852941 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.853269 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.853638 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.853957 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.854277 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.854597 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.854915 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.855231 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.855547 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.855905 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.856241 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.856554 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.856881 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.857384 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.857801 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.858130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.858452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.858793 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.859096 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writer thread running {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:37:31.859204 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.859418 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.859759 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.860085 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.860402 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.860729 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.861047 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.861363 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.861689 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.862018 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.862351 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.862682 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.863000 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.863330 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.863683 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.864041 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.864381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.864715 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.865050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.865371 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.865690 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.866001 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:37:31.866245 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 05:37:31.914803 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.context [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),129586bd-1da0-4623-9b26-5cb41c4ec3d8(cell1) {{(pid=132497) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 05:37:31.918875 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:37:31.919347 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:37:31.920980 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:37:31.921698 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:37:31.922136 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:37:31.924138 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:37:31.926118 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO dbcounter [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] Registered counter for database nova_cell0 Aug 22 05:37:31.927562 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO dbcounter [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] Registered counter for database nova_api Aug 22 05:37:31.930112 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO dbcounter [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] Registered counter for database nova_cell1 Aug 22 05:37:31.937562 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_db.sqlalchemy.engines [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:37:31.938932 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_db.sqlalchemy.engines [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:37:31.945343 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writer thread running {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:37:31.946931 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writer thread running {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:37:31.948711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_db.sqlalchemy.engines [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:37:31.955476 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writer thread running {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:37:32.011685 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.context [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),129586bd-1da0-4623-9b26-5cb41c4ec3d8(cell1) {{(pid=132498) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 05:37:32.015723 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:37:32.016200 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:37:32.017799 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:37:32.018534 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:37:32.019008 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:37:32.021027 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:37:32.023034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO dbcounter [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] Registered counter for database nova_cell0 Aug 22 05:37:32.027144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO dbcounter [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] Registered counter for database nova_cell1 Aug 22 05:37:32.034754 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_db.sqlalchemy.engines [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:37:32.036532 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_db.sqlalchemy.engines [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:37:32.042197 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writer thread running {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:37:32.044730 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writer thread running {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:37:32.094142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO dbcounter [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] Registered counter for database nova_cell0 Aug 22 05:37:32.102192 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_db.sqlalchemy.engines [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:37:32.107867 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writer thread running {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:37:32.191484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO dbcounter [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] Registered counter for database nova_cell0 Aug 22 05:37:32.198577 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_db.sqlalchemy.engines [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:37:32.203734 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writer thread running {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:37:32.423639 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: WARNING keystonemiddleware.auth_token [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 05:37:32.430951 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: WARNING keystonemiddleware.auth_token [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 05:37:32.522779 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: WARNING keystonemiddleware.auth_token [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 05:37:32.530245 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: WARNING keystonemiddleware.auth_token [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 05:37:32.777005 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: WARNING keystonemiddleware.auth_token [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 05:37:32.785068 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: WARNING keystonemiddleware.auth_token [None req-f8fd7527-ea75-4cc6-91b7-ea71373ff6ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 05:37:32.792320 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e697b559c0 pid: 132497 (default app) Aug 22 05:37:32.883564 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: WARNING keystonemiddleware.auth_token [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 05:37:32.889703 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: WARNING keystonemiddleware.auth_token [None req-8c7506e4-d510-431c-a280-ee90429768d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 05:37:32.895084 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e697b559c0 pid: 132498 (default app) Aug 22 05:38:08.383916 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=3 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:08.385615 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=3 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:08.386881 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=3 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:08.388156 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=3 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:08.622928 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:08.624031 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:08.624767 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:08.625485 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:10.490301 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5d63533f-0d2c-4f52-a457-ca0cf1dced9d tempest-VolumesGetTestJSON-1295051613 tempest-VolumesGetTestJSON-1295051613-project] Action: 'create', calling method: .version_select at 0x7f0b3fef65e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-116516722", "metadata": {"Type": "work"}}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:38:10.789518 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8a94cfee-e37e-4a9d-ab77-d99d560033f1 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Action: 'create', calling method: .version_select at 0x7f0b3fef35e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-37092039"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:38:12.760098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5d63533f-0d2c-4f52-a457-ca0cf1dced9d tempest-VolumesGetTestJSON-1295051613 tempest-VolumesGetTestJSON-1295051613-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.387258 Aug 22 05:38:12.761367 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1156 bytes} [Mon Aug 22 05:38:08 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4390 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 22 05:38:12.767381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6b5feec6-277f-42bc-ad7a-0757b3751177 tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] Calling method '.version_select at 0x7f0b3fdc94c0>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:12.987395 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6b5feec6-277f-42bc-ad7a-0757b3751177 tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/2b6e8d14-5b49-457a-9351-be5b075d5f4f" status: 200 len: 351 microversion: 2.1 time: 0.224922 Aug 22 05:38:12.988907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 2/2] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 22 05:38:12 2022] GET /compute/v2.1/os-volumes/2b6e8d14-5b49-457a-9351-be5b075d5f4f => generated 351 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:13.003305 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8222ed16-e139-44b5-a35c-85213fe92c32 tempest-VolumesGetTestJSON-1295051613 tempest-VolumesGetTestJSON-1295051613-project] Calling method '.version_select at 0x7f0b3fdc9c10>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:13.145468 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8a94cfee-e37e-4a9d-ab77-d99d560033f1 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 4.527684 Aug 22 05:38:13.146989 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1155 bytes} [Mon Aug 22 05:38:08 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 4531 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 22 05:38:13.164749 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-592d7065-0154-4e6f-b1a3-fa1b9185518f tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3fdc94c0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:13.719821 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8222ed16-e139-44b5-a35c-85213fe92c32 tempest-VolumesGetTestJSON-1295051613 tempest-VolumesGetTestJSON-1295051613-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/a165d398-4f7e-4093-b529-dfb35cc3dab1" status: 200 len: 353 microversion: 2.1 time: 0.726824 Aug 22 05:38:13.721440 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 22 05:38:12 2022] GET /compute/v2.1/os-volumes/a165d398-4f7e-4093-b529-dfb35cc3dab1 => generated 353 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:13.744105 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f62dd060-e1b1-4c90-afb9-642c5e88208a tempest-VolumesGetTestJSON-1295051613 tempest-VolumesGetTestJSON-1295051613-project] Calling method '.version_select at 0x7f0b3fde4310>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:14.211653 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-592d7065-0154-4e6f-b1a3-fa1b9185518f tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2" status: 200 len: 344 microversion: 2.1 time: 1.051443 Aug 22 05:38:14.212370 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 2/5] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 22 05:38:13 2022] GET /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2 => generated 344 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:38:14.227362 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-72860d2d-c2f2-4fc3-ae3d-8c0a882db0d8 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Action: 'create', calling method: .version_select at 0x7f0b3fdc9af0>, body: {"snapshot": {"volume_id": "255cbe8e-cedb-4171-84c6-67271f1efde2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-457067763"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:38:14.405524 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f62dd060-e1b1-4c90-afb9-642c5e88208a tempest-VolumesGetTestJSON-1295051613 tempest-VolumesGetTestJSON-1295051613-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/a165d398-4f7e-4093-b529-dfb35cc3dab1" status: 200 len: 353 microversion: 2.1 time: 0.674799 Aug 22 05:38:14.406436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 4/6] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 22 05:38:13 2022] GET /compute/v2.1/os-volumes/a165d398-4f7e-4093-b529-dfb35cc3dab1 => generated 353 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:14.424595 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f02eb360-fbb9-4fd3-8ff7-a28781bb63dc tempest-VolumesGetTestJSON-1295051613 tempest-VolumesGetTestJSON-1295051613-project] Calling method '.version_select at 0x7f0b3fdc9c10>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:15.281733 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f02eb360-fbb9-4fd3-8ff7-a28781bb63dc tempest-VolumesGetTestJSON-1295051613 tempest-VolumesGetTestJSON-1295051613-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/a165d398-4f7e-4093-b529-dfb35cc3dab1" status: 202 len: 0 microversion: 2.1 time: 0.859488 Aug 22 05:38:15.282988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 5/7] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 22 05:38:14 2022] DELETE /compute/v2.1/os-volumes/a165d398-4f7e-4093-b529-dfb35cc3dab1 => generated 0 bytes in 863 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:38:15.289452 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-640f2666-8aea-43a6-b8dc-425320ce7020 tempest-VolumesGetTestJSON-1295051613 tempest-VolumesGetTestJSON-1295051613-project] Calling method '.version_select at 0x7f0b3fdc94c0>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:15.563659 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-72860d2d-c2f2-4fc3-ae3d-8c0a882db0d8 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.339895 Aug 22 05:38:15.564978 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 3/8] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Aug 22 05:38:14 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:38:15.577574 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2df999c7-8218-4629-9f49-69441fe72308 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3fde0d30>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:15.613866 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-640f2666-8aea-43a6-b8dc-425320ce7020 tempest-VolumesGetTestJSON-1295051613 tempest-VolumesGetTestJSON-1295051613-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/a165d398-4f7e-4093-b529-dfb35cc3dab1" status: 200 len: 352 microversion: 2.1 time: 0.328308 Aug 22 05:38:15.615327 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 6/9] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 22 05:38:15 2022] GET /compute/v2.1/os-volumes/a165d398-4f7e-4093-b529-dfb35cc3dab1 => generated 352 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:15.680008 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2df999c7-8218-4629-9f49-69441fe72308 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e" status: 200 len: 286 microversion: 2.1 time: 0.107378 Aug 22 05:38:15.680846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 4/10] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 22 05:38:15 2022] GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e => generated 286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:15.691789 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e59e41ae-a4d3-4d9c-9436-028ad186ab46 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3fde4430>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:15.710457 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2ecd7003-7f57-48c0-a6d5-362fd3425bff tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] Calling method '.version_select at 0x7f0b3fde0700>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:15.787834 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e59e41ae-a4d3-4d9c-9436-028ad186ab46 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.099765 Aug 22 05:38:15.794313 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 7/11] 10.222.0.18 () {58 vars in 1140 bytes} [Mon Aug 22 05:38:15 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:15.800017 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e518236b-b5a7-467f-bd17-eec88f54efcc tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3fde4d30>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:15.833426 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2ecd7003-7f57-48c0-a6d5-362fd3425bff tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/329606a8-af7c-4203-8034-eee012b5a1e6" status: 200 len: 351 microversion: 2.1 time: 0.127348 Aug 22 05:38:15.834650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 5/12] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 22 05:38:15 2022] GET /compute/v2.1/os-volumes/329606a8-af7c-4203-8034-eee012b5a1e6 => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:15.862950 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e518236b-b5a7-467f-bd17-eec88f54efcc tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e" status: 200 len: 286 microversion: 2.1 time: 0.066915 Aug 22 05:38:15.863523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 8/13] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 22 05:38:15 2022] GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:38:16.628814 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-81af803f-7695-4b44-baca-8fd96f93e926 tempest-VolumesGetTestJSON-1295051613 tempest-VolumesGetTestJSON-1295051613-project] Calling method '.version_select at 0x7f0b4079f8b0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:16.733821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-81af803f-7695-4b44-baca-8fd96f93e926 tempest-VolumesGetTestJSON-1295051613 tempest-VolumesGetTestJSON-1295051613-project] HTTP exception thrown: Volume a165d398-4f7e-4093-b529-dfb35cc3dab1 could not be found. Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-81af803f-7695-4b44-baca-8fd96f93e926 tempest-VolumesGetTestJSON-1295051613 tempest-VolumesGetTestJSON-1295051613-project] Request method failure captured: Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/os-volumes/a165d398-4f7e-4093-b529-dfb35cc3dab1 HTTP/1.1 Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxZATvkweKj6ku5OOlXIsP9xaFSuioKNpJYh_aj-paffDwtoV1UBBowy-h_eBEn7CfZi1bgeOPlz2E5OcVJip6ko89s5YGYmdTd6CXNhNV69-75u1Z8-onM24ck4xWruC6qcE9-DUyxYDMDfDoJnbJxEHsYTNKSrRC6gIeYx2n8Rd38 Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: b6bddea5c8484dab9602d2eb375aafc1 Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesGetTestJSON-1295051613 Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:38:16.738214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:38:16.739624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b6bddea5c8484dab9602d2eb375aafc1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6bddea5c8484dab9602d2eb375aafc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6bddea5c8484dab9602d2eb375aafc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b6bddea5c8484dab9602d2eb375aafc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:38:16.739624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesGetTestJSON-1295051613 Aug 22 05:38:16.739624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: b6bddea5c8484dab9602d2eb375aafc1 Aug 22 05:38:16.739624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesGetTestJSON-1295051613 Aug 22 05:38:16.739624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesGetTestJSON-1295051613-project Aug 22 05:38:16.739624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:38:16.739624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:38:16.739624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: c7bc901f44404ae48fb265243d8ffdcb Aug 22 05:38:16.739624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesGetTestJSON-1295051613-project Aug 22 05:38:16.739624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: Aug 22 05:38:16.739624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Volume a165d398-4f7e-4093-b529-dfb35cc3dab1 could not be found. Aug 22 05:38:16.739624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': 'a165d398-4f7e-4093-b529-dfb35cc3dab1'} Aug 22 05:38:16.739624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a165d398-4f7e-4093-b529-dfb35cc3dab1 could not be found. (HTTP 404) (Request-ID: req-dbb9d83e-7bce-43fb-9c83-e116f18803f3) Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:38:16.740448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 05:38:16.741611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a165d398-4f7e-4093-b529-dfb35cc3dab1 could not be found. Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 05:38:16.743527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:38:16.745652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a165d398-4f7e-4093-b529-dfb35cc3dab1 could not be found. Aug 22 05:38:16.745652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:38:16.745652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:38:16.745652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:38:16.745652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:16.745652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:38:16.745652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:38:16.745652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:38:16.745652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:38:16.745652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a165d398-4f7e-4093-b529-dfb35cc3dab1 could not be found. Aug 22 05:38:16.745652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:38:16.745652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-81af803f-7695-4b44-baca-8fd96f93e926 tempest-VolumesGetTestJSON-1295051613 tempest-VolumesGetTestJSON-1295051613-project] Returning 404 to user: Volume a165d398-4f7e-4093-b529-dfb35cc3dab1 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:38:16.745652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-81af803f-7695-4b44-baca-8fd96f93e926 tempest-VolumesGetTestJSON-1295051613 tempest-VolumesGetTestJSON-1295051613-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/a165d398-4f7e-4093-b529-dfb35cc3dab1" status: 404 len: 109 microversion: 2.1 time: 0.115099 Aug 22 05:38:16.745652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 6/14] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 22 05:38:16 2022] GET /compute/v2.1/os-volumes/a165d398-4f7e-4093-b529-dfb35cc3dab1 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:38:16.876757 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e84d1977-2aaa-451c-aa53-f35543e06d07 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3fde44c0>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:16.968217 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e84d1977-2aaa-451c-aa53-f35543e06d07 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e" status: 200 len: 286 microversion: 2.1 time: 0.096444 Aug 22 05:38:16.969875 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 9/15] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 22 05:38:16 2022] GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e => generated 286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:17.983476 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-785c019c-854c-4163-b62b-6a89ea7a6b76 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3fef3ee0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:18.072308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-785c019c-854c-4163-b62b-6a89ea7a6b76 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e" status: 200 len: 286 microversion: 2.1 time: 0.094444 Aug 22 05:38:18.078251 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 7/16] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 22 05:38:17 2022] GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:18.359288 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1696465012", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:38:18.567228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.network.neutron [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] validate_networks() for [('23303343-c5c8-4098-b67c-994458fa3aea', None, None, None, None, None)] {{(pid=132497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:38:19.197260 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2014491928", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452", "networks": [{"uuid": "d3f284f1-428a-4bb1-b174-c4eb114239db"}]}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:38:19.467270 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] validate_networks() for [('d3f284f1-428a-4bb1-b174-c4eb114239db', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:38:20.384346 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Flavor limits 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:38:20.384859 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Image limits 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:38:20.386069 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Flavor pref 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:38:20.386489 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Image pref 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:38:20.387447 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:38:20.457985 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:20.458476 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:20.463793 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:20.467177 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:20.467684 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:20.468121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:20.571150 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Getting quotas for project 8cadb48afce14e758bfe62771530527a. Resources: {'cores', 'instances', 'ram'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:38:20.579541 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Getting quotas for user 9643b0f10e8345889c181efbb1978237 and project 8cadb48afce14e758bfe62771530527a. Resources: {'cores', 'instances', 'ram'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:38:20.602500 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Going to run 1 instances... {{(pid=132497) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:38:20.606397 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:38:20.818986 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b1230425-1089-480d-8d9a-33a331475084 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.779647 Aug 22 05:38:20.823344 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 10/17] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:38:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:38:20.844990 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0d74ae65-0380-42eb-b06f-cc107acab7c1 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3f47e160>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:20.918762 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0d74ae65-0380-42eb-b06f-cc107acab7c1 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e" status: 200 len: 286 microversion: 2.1 time: 0.091013 Aug 22 05:38:20.919337 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 11/18] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 22 05:38:20 2022] GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:20.924404 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-50cf0383-9534-4eeb-bc5f-3bc45dc9c76f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:20.925213 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-50cf0383-9534-4eeb-bc5f-3bc45dc9c76f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:21.458078 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:38:21.458563 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:38:21.459140 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:38:21.459894 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:38:21.460501 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:38:21.489934 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:21.490739 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:21.494085 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:21.497979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:21.498855 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:21.499800 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:21.544522 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-50cf0383-9534-4eeb-bc5f-3bc45dc9c76f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:21.574103 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-50cf0383-9534-4eeb-bc5f-3bc45dc9c76f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1222 microversion: 2.1 time: 0.652363 Aug 22 05:38:21.576206 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 12/19] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:20 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1222 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:21.588281 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Getting quotas for project 822f0c2e66354549aeb13d73c512b09d. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:38:21.606724 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Getting quotas for user 904630cc2e60419d88afd9cfc1c5914d and project 822f0c2e66354549aeb13d73c512b09d. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:38:21.652894 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:38:21.663550 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:38:21.986487 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a722009a-562c-4d09-acb8-6e8b27272c55 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.989476 Aug 22 05:38:21.995078 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 8/20] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:38:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:38:22.000828 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2c6095bc-30f1-4972-9a03-7679cead2545 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3f450820>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:22.085659 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2c6095bc-30f1-4972-9a03-7679cead2545 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e" status: 200 len: 287 microversion: 2.1 time: 0.088713 Aug 22 05:38:22.087376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 9/21] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 22 05:38:21 2022] GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:22.097473 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-294765340", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:38:22.164355 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e0dc59af-c9d9-4bd2-8403-faadb9ef838c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Action: 'create', calling method: .version_select at 0x7f0b3f48d5e0>, body: {"keypair": {"name": "tempest-keypair-571824452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGr9KDjUdg3j6WebxpnNlHLbNsEFRftMP7PXydEufoDDsLgwksHWHR3NMxLETdCuPFMcs4bowLHjlpQAPBHB8WG5A3mFZ9zP4k7eNmzmUh93ySvz2npS2lI0z4P1m7DbCw=="}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:38:22.219866 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-e0dc59af-c9d9-4bd2-8403-faadb9ef838c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Getting quotas for project 8e8481f1683045d4a63b3d33e0dab620. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:38:22.231851 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-e0dc59af-c9d9-4bd2-8403-faadb9ef838c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Getting quotas for user 8e68f520aaff495abfb4b7a5271936e1 and project 8e8481f1683045d4a63b3d33e0dab620. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:38:22.329715 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] validate_networks() for [('23303343-c5c8-4098-b67c-994458fa3aea', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:38:22.337087 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e0dc59af-c9d9-4bd2-8403-faadb9ef838c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.527317 Aug 22 05:38:22.358237 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 13/22] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 22 05:38:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:22.370265 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-261a5959-83a6-49c1-836a-d41f307bbb8c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:22.371117 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-261a5959-83a6-49c1-836a-d41f307bbb8c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:22.501836 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-261a5959-83a6-49c1-836a-d41f307bbb8c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:22.514409 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-261a5959-83a6-49c1-836a-d41f307bbb8c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1215 microversion: 2.1 time: 0.155032 Aug 22 05:38:22.534527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 14/23] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:22 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1215 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:22.561472 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-9d5e94ea-8107-4b7b-bf26-ee2b5e31427d tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3ec45430>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:22.750823 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-9d5e94ea-8107-4b7b-bf26-ee2b5e31427d tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e" status: 202 len: 0 microversion: 2.1 time: 0.215007 Aug 22 05:38:22.751612 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 15/24] 10.222.0.18 () {58 vars in 1254 bytes} [Mon Aug 22 05:38:22 2022] DELETE /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:38:22.767989 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-1d410c02-2d30-4c25-b043-7e2c4a1581ec tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3ec45550>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:22.893209 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-1d410c02-2d30-4c25-b043-7e2c4a1581ec tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e" status: 200 len: 286 microversion: 2.1 time: 0.136551 Aug 22 05:38:22.894485 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 16/25] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 22 05:38:22 2022] GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e => generated 286 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:23.478380 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:38:23.479437 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:38:23.480703 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:38:23.481160 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:38:23.481932 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:38:23.517915 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:23.519121 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:23.519745 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:23.521359 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:23.522823 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:23.525508 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:23.542150 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-cbff502b-9b13-4af4-95db-d47e0f897f01 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:23.543204 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-cbff502b-9b13-4af4-95db-d47e0f897f01 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:23.579463 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Getting quotas for project 8cadb48afce14e758bfe62771530527a. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:38:23.594847 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Getting quotas for user 9643b0f10e8345889c181efbb1978237 and project 8cadb48afce14e758bfe62771530527a. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:38:23.620825 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:38:23.625225 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:38:23.659833 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-cbff502b-9b13-4af4-95db-d47e0f897f01 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:23.667131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-cbff502b-9b13-4af4-95db-d47e0f897f01 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1215 microversion: 2.1 time: 0.129541 Aug 22 05:38:23.687792 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 17/26] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:23 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1215 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:23.776487 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-006a9b9c-c741-44d0-9ae9-8de36143dbfb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.679581 Aug 22 05:38:23.795311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-92c0d4e5-b241-42d4-8583-e3442ef419ef tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:23.796618 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-92c0d4e5-b241-42d4-8583-e3442ef419ef tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:23.807066 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 10/27] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:38:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:38:23.906684 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1d8f880f-bd05-4e8f-a43a-6be8d86a3e8a tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3fdc98b0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:23.925062 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-92c0d4e5-b241-42d4-8583-e3442ef419ef tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:23.937653 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-92c0d4e5-b241-42d4-8583-e3442ef419ef tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1221 microversion: 2.1 time: 0.147462 Aug 22 05:38:23.938905 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 18/28] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:23 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1221 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:23.964652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1d8f880f-bd05-4e8f-a43a-6be8d86a3e8a tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e" status: 200 len: 286 microversion: 2.1 time: 0.061838 Aug 22 05:38:23.967699 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 11/29] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 22 05:38:23 2022] GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:24.694527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-3721562e-98a1-41ac-8a32-ab0a5d92ee18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:24.695781 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-3721562e-98a1-41ac-8a32-ab0a5d92ee18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:24.706429 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3721562e-98a1-41ac-8a32-ab0a5d92ee18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:24.708178 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3721562e-98a1-41ac-8a32-ab0a5d92ee18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:24.709574 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3721562e-98a1-41ac-8a32-ab0a5d92ee18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:24.710827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3721562e-98a1-41ac-8a32-ab0a5d92ee18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:24.712011 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3721562e-98a1-41ac-8a32-ab0a5d92ee18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:24.712911 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3721562e-98a1-41ac-8a32-ab0a5d92ee18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:24.897491 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-3721562e-98a1-41ac-8a32-ab0a5d92ee18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:24.913897 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-3721562e-98a1-41ac-8a32-ab0a5d92ee18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1219 microversion: 2.1 time: 0.223092 Aug 22 05:38:24.914474 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 19/30] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:24 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1219 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:24.958455 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c51257f6-1a35-4196-a0c2-f87e161d565f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:24.959148 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c51257f6-1a35-4196-a0c2-f87e161d565f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:24.978145 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-92eaf859-d9aa-48f0-b0ff-6b7af5ee4861 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3e3ca8b0>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:24.988491 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c51257f6-1a35-4196-a0c2-f87e161d565f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:24.989448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c51257f6-1a35-4196-a0c2-f87e161d565f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:24.990080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c51257f6-1a35-4196-a0c2-f87e161d565f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:24.991474 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c51257f6-1a35-4196-a0c2-f87e161d565f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:24.992242 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c51257f6-1a35-4196-a0c2-f87e161d565f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:24.992930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c51257f6-1a35-4196-a0c2-f87e161d565f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:25.037612 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-92eaf859-d9aa-48f0-b0ff-6b7af5ee4861 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e" status: 200 len: 286 microversion: 2.1 time: 0.063178 Aug 22 05:38:25.038307 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 20/31] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 22 05:38:24 2022] GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:38:25.214452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c51257f6-1a35-4196-a0c2-f87e161d565f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:25.258710 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-524560686", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "629267ab-1398-436b-bf36-0ee4763d8e9a"}], "security_groups": [{"name": "tempest-securitygroup--264342715"}], "key_name": "tempest-keypair-571824452", "user_data": "}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:38:25.265427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c51257f6-1a35-4196-a0c2-f87e161d565f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1225 microversion: 2.1 time: 0.310851 Aug 22 05:38:25.266080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 12/32] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:24 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1225 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:38:25.477736 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.network.neutron [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] validate_networks() for [('629267ab-1398-436b-bf36-0ee4763d8e9a', None, None, None, None, None)] {{(pid=132497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:38:25.938550 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1a302bf5-f5a2-4bd8-9556-7f965f9e7fcb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:25.939672 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1a302bf5-f5a2-4bd8-9556-7f965f9e7fcb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:25.952476 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1a302bf5-f5a2-4bd8-9556-7f965f9e7fcb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:25.961546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1a302bf5-f5a2-4bd8-9556-7f965f9e7fcb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:25.968785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1a302bf5-f5a2-4bd8-9556-7f965f9e7fcb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:25.969872 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1a302bf5-f5a2-4bd8-9556-7f965f9e7fcb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:25.970611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1a302bf5-f5a2-4bd8-9556-7f965f9e7fcb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:25.971479 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1a302bf5-f5a2-4bd8-9556-7f965f9e7fcb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:26.152884 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1a302bf5-f5a2-4bd8-9556-7f965f9e7fcb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:26.174028 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1a302bf5-f5a2-4bd8-9556-7f965f9e7fcb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1219 microversion: 2.1 time: 0.235664 Aug 22 05:38:26.174886 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 13/33] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:25 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1219 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:26.185019 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-557f7ceb-6216-4999-b81c-8cc584f5b823 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3eba30d0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:26.256765 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-557f7ceb-6216-4999-b81c-8cc584f5b823 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e" status: 200 len: 286 microversion: 2.1 time: 0.080725 Aug 22 05:38:26.257721 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 14/34] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 22 05:38:26 2022] GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:26.289609 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b1868634-3910-4f43-9fa6-db7a9d4bdf27 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:26.290747 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b1868634-3910-4f43-9fa6-db7a9d4bdf27 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:26.324910 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1868634-3910-4f43-9fa6-db7a9d4bdf27 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:26.326549 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1868634-3910-4f43-9fa6-db7a9d4bdf27 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:26.327112 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1868634-3910-4f43-9fa6-db7a9d4bdf27 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:26.332159 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1868634-3910-4f43-9fa6-db7a9d4bdf27 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:26.332863 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1868634-3910-4f43-9fa6-db7a9d4bdf27 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:26.337732 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1868634-3910-4f43-9fa6-db7a9d4bdf27 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:26.490307 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Flavor limits 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:38:26.490801 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Image limits 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:38:26.491179 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Flavor pref 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:38:26.491936 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Image pref 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:38:26.492342 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:38:26.504549 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:26.505057 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:26.505500 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:26.506256 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:26.506709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:26.507176 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:26.510348 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b1868634-3910-4f43-9fa6-db7a9d4bdf27 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:26.521130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b1868634-3910-4f43-9fa6-db7a9d4bdf27 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1225 microversion: 2.1 time: 0.235975 Aug 22 05:38:26.530151 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Getting quotas for project 8e8481f1683045d4a63b3d33e0dab620. Resources: {'cores', 'instances', 'ram'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:38:26.531071 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 15/35] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:26 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1225 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:26.535416 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Getting quotas for user 8e68f520aaff495abfb4b7a5271936e1 and project 8e8481f1683045d4a63b3d33e0dab620. Resources: {'cores', 'instances', 'ram'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:38:26.577953 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Going to run 1 instances... {{(pid=132497) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:38:26.582371 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:38:26.707541 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-cd42e559-5b17-4ea7-9a9f-ce002e0a0fb3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.453353 Aug 22 05:38:26.714675 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 21/36] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:38:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 05:38:26.722388 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b634c229-12a5-4b99-9cb3-1a5e76fdea49 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:26.723013 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b634c229-12a5-4b99-9cb3-1a5e76fdea49 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:26.804052 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b634c229-12a5-4b99-9cb3-1a5e76fdea49 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:26.816676 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b634c229-12a5-4b99-9cb3-1a5e76fdea49 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1236 microversion: 2.1 time: 0.100615 Aug 22 05:38:26.817614 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 16/37] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:26 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1236 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:38:27.197068 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-329de4ed-8f1a-47d9-acf5-66d85eb43464 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:27.197978 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-329de4ed-8f1a-47d9-acf5-66d85eb43464 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:27.214257 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-329de4ed-8f1a-47d9-acf5-66d85eb43464 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:27.214954 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-329de4ed-8f1a-47d9-acf5-66d85eb43464 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:27.215979 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-329de4ed-8f1a-47d9-acf5-66d85eb43464 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:27.217975 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-329de4ed-8f1a-47d9-acf5-66d85eb43464 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:27.221079 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-329de4ed-8f1a-47d9-acf5-66d85eb43464 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:27.221547 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-329de4ed-8f1a-47d9-acf5-66d85eb43464 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:27.270862 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4e5276d7-ffa0-41fa-a926-80ce7d71336d tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3f450940>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:27.298793 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-329de4ed-8f1a-47d9-acf5-66d85eb43464 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:27.307471 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-329de4ed-8f1a-47d9-acf5-66d85eb43464 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1267 microversion: 2.1 time: 0.116732 Aug 22 05:38:27.308093 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 22/38] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:27 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1267 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:27.330063 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4e5276d7-ffa0-41fa-a926-80ce7d71336d tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e" status: 200 len: 286 microversion: 2.1 time: 0.063310 Aug 22 05:38:27.335948 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 17/39] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 22 05:38:27 2022] GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:27.542654 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-64952fb6-b76c-46fd-92a7-b68e9ed37987 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:27.543276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-64952fb6-b76c-46fd-92a7-b68e9ed37987 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:27.551822 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-64952fb6-b76c-46fd-92a7-b68e9ed37987 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:27.563353 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-64952fb6-b76c-46fd-92a7-b68e9ed37987 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:27.564276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-64952fb6-b76c-46fd-92a7-b68e9ed37987 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:27.565190 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-64952fb6-b76c-46fd-92a7-b68e9ed37987 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:27.565778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-64952fb6-b76c-46fd-92a7-b68e9ed37987 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:27.566367 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-64952fb6-b76c-46fd-92a7-b68e9ed37987 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:27.600503 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-92a3660b-75b3-4096-aeda-2f9fa09ccd7e tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] Calling method '.version_select at 0x7f0b3eba3af0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:27.717921 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-92a3660b-75b3-4096-aeda-2f9fa09ccd7e tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f6e0bdde-6c0d-4298-b216-6dcaca2832bb" status: 200 len: 350 microversion: 2.1 time: 0.121161 Aug 22 05:38:27.719319 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 18/40] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 22 05:38:27 2022] GET /compute/v2.1/os-volumes/f6e0bdde-6c0d-4298-b216-6dcaca2832bb => generated 350 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:27.728253 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-64952fb6-b76c-46fd-92a7-b68e9ed37987 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:27.736919 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-25883b83-83fb-4a9e-a0e2-9965d30f347b tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] Calling method '.version_select at 0x7f0b3ebac280>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:27.764696 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-64952fb6-b76c-46fd-92a7-b68e9ed37987 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1281 microversion: 2.1 time: 0.215728 Aug 22 05:38:27.764696 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 23/41] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:27 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1281 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:27.838056 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-93dbb2c4-fb5a-42b6-a524-bbb9b23387f3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:27.838711 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-93dbb2c4-fb5a-42b6-a524-bbb9b23387f3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:27.847549 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-93dbb2c4-fb5a-42b6-a524-bbb9b23387f3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:27.848118 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-93dbb2c4-fb5a-42b6-a524-bbb9b23387f3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:27.848563 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-93dbb2c4-fb5a-42b6-a524-bbb9b23387f3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:27.849281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-93dbb2c4-fb5a-42b6-a524-bbb9b23387f3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:27.849740 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-93dbb2c4-fb5a-42b6-a524-bbb9b23387f3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:27.850165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-93dbb2c4-fb5a-42b6-a524-bbb9b23387f3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:28.028078 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-25883b83-83fb-4a9e-a0e2-9965d30f347b tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.300114 Aug 22 05:38:28.043278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 19/42] 10.222.0.18 () {58 vars in 1134 bytes} [Mon Aug 22 05:38:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:28.049465 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4ca96d54-d441-47e9-9658-551b5e1b16bb tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] Calling method '.version_select at 0x7f0b3ebac9d0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:28.067998 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-93dbb2c4-fb5a-42b6-a524-bbb9b23387f3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:28.079026 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-93dbb2c4-fb5a-42b6-a524-bbb9b23387f3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1232 microversion: 2.1 time: 0.244660 Aug 22 05:38:28.079643 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 24/43] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:27 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1232 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:38:28.332572 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-32389b6a-4aa4-4b44-9d3d-4c0f4cc80ddd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:28.333603 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-32389b6a-4aa4-4b44-9d3d-4c0f4cc80ddd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:28.340272 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32389b6a-4aa4-4b44-9d3d-4c0f4cc80ddd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:28.341179 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32389b6a-4aa4-4b44-9d3d-4c0f4cc80ddd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:28.341716 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32389b6a-4aa4-4b44-9d3d-4c0f4cc80ddd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:28.342855 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32389b6a-4aa4-4b44-9d3d-4c0f4cc80ddd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:28.343935 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32389b6a-4aa4-4b44-9d3d-4c0f4cc80ddd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:28.344718 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32389b6a-4aa4-4b44-9d3d-4c0f4cc80ddd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:28.417221 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-32389b6a-4aa4-4b44-9d3d-4c0f4cc80ddd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:28.426671 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-32389b6a-4aa4-4b44-9d3d-4c0f4cc80ddd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1285 microversion: 2.1 time: 0.098386 Aug 22 05:38:28.427713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 25/44] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:28 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:28.447555 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-25257dff-afa0-4e5d-ad7e-00c50f290687 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3e3ca8b0>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:28.626107 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4ca96d54-d441-47e9-9658-551b5e1b16bb tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.580435 Aug 22 05:38:28.631403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 20/45] 10.222.0.18 () {58 vars in 1149 bytes} [Mon Aug 22 05:38:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:28.642658 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-25257dff-afa0-4e5d-ad7e-00c50f290687 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] HTTP exception thrown: Snapshot b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e could not be found. Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-25257dff-afa0-4e5d-ad7e-00c50f290687 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Request method failure captured: Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e HTTP/1.1 Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxZAj3uPctVUyNNYsamCdiCFtvqYoSAXXxQW40XLKD2KpSt1_l7wW0cuO-8tPWPX1Ezyps9bNzrKSwFys3Z14I4aD-dUKMvkVy9OhWBp9XErYbNe1whu8F4yTTwAtFmz-PmMJKnvUIyzFDihwJox-4wRhdB2hLXukWjSP2bRoQ_omH0 Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: c37fd468d46f4348b13b002e26f2ee3a Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-68529632 Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:38:28.652840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:38:28.654399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c37fd468d46f4348b13b002e26f2ee3a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c37fd468d46f4348b13b002e26f2ee3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c37fd468d46f4348b13b002e26f2ee3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c37fd468d46f4348b13b002e26f2ee3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:38:28.654399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-VolumesSnapshotsTestJSON-68529632 Aug 22 05:38:28.654399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: c37fd468d46f4348b13b002e26f2ee3a Aug 22 05:38:28.654399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-68529632 Aug 22 05:38:28.654399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-VolumesSnapshotsTestJSON-68529632-project Aug 22 05:38:28.654399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:38:28.654399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:38:28.654399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: 7395ad97ab494323a7f92ea53b3d910a Aug 22 05:38:28.654399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-VolumesSnapshotsTestJSON-68529632-project Aug 22 05:38:28.654399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: Aug 22 05:38:28.654399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Snapshot b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e could not be found. Aug 22 05:38:28.654399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': 'b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e'} Aug 22 05:38:28.654399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e could not be found. (HTTP 404) (Request-ID: req-4306ad8f-8f9f-4a6c-9785-f69820bade91) Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:28.655350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 05:38:28.656511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e could not be found. Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 22 05:38:28.657427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:38:28.658453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e could not be found. Aug 22 05:38:28.658453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:28.658453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:38:28.658453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:28.658453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:28.658453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:38:28.658453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:38:28.658453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:38:28.658453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:38:28.658453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e could not be found. Aug 22 05:38:28.658453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:28.658453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-25257dff-afa0-4e5d-ad7e-00c50f290687 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Returning 404 to user: Snapshot b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:38:28.659050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ba1c9d0a-7fad-4d0b-8572-aa1427a5a595 tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] Calling method '.version_select at 0x7f0b3eba3e50>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:28.659131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-25257dff-afa0-4e5d-ad7e-00c50f290687 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e" status: 404 len: 111 microversion: 2.1 time: 0.216076 Aug 22 05:38:28.662245 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 26/46] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 22 05:38:28 2022] GET /compute/v2.1/os-snapshots/b4d914fd-f8aa-420d-ac83-d3ed88d9ff0e => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:38:28.675560 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-fd768575-73b8-4a5f-a219-120a4738c032 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3e3d9280>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:28.788988 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ba1c9d0a-7fad-4d0b-8572-aa1427a5a595 tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.142891 Aug 22 05:38:28.797708 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 21/47] 10.222.0.18 () {58 vars in 1134 bytes} [Mon Aug 22 05:38:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:28.797708 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-cbad9f1c-4b48-400e-8f8c-d84f454e1de5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:28.797708 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-cbad9f1c-4b48-400e-8f8c-d84f454e1de5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:28.806381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cbad9f1c-4b48-400e-8f8c-d84f454e1de5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:28.807090 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cbad9f1c-4b48-400e-8f8c-d84f454e1de5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:28.807806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cbad9f1c-4b48-400e-8f8c-d84f454e1de5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:28.809170 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cbad9f1c-4b48-400e-8f8c-d84f454e1de5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:28.809912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cbad9f1c-4b48-400e-8f8c-d84f454e1de5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:28.814906 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cbad9f1c-4b48-400e-8f8c-d84f454e1de5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:28.864401 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-fd768575-73b8-4a5f-a219-120a4738c032 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2" status: 202 len: 0 microversion: 2.1 time: 0.200038 Aug 22 05:38:28.864950 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 27/48] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 22 05:38:28 2022] DELETE /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:38:28.879621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f2308df6-c272-48df-8509-913e75718c27 tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] Calling method '.version_select at 0x7f0b3f4a3f70>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:28.927331 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-cbad9f1c-4b48-400e-8f8c-d84f454e1de5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:28.937340 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-cbad9f1c-4b48-400e-8f8c-d84f454e1de5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1279 microversion: 2.1 time: 0.144902 Aug 22 05:38:28.937927 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 22/49] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:28 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1279 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:28.943190 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c9697269-29d4-49e5-b282-c2401ef115be tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3ebac430>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:28.974880 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f2308df6-c272-48df-8509-913e75718c27 tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.105074 Aug 22 05:38:28.975461 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 28/50] 10.222.0.18 () {58 vars in 1167 bytes} [Mon Aug 22 05:38:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:28.989156 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-cd00ac8d-9c73-42bc-9f1a-d072a6108738 tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] Calling method '.version_select at 0x7f0b3e3375e0>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:28.992922 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c9697269-29d4-49e5-b282-c2401ef115be tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2" status: 200 len: 343 microversion: 2.1 time: 0.053707 Aug 22 05:38:28.993761 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 23/51] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 22 05:38:28 2022] GET /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2 => generated 343 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:29.074094 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-cd00ac8d-9c73-42bc-9f1a-d072a6108738 tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088874 Aug 22 05:38:29.074710 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 29/52] 10.222.0.18 () {58 vars in 1170 bytes} [Mon Aug 22 05:38:28 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:29.088113 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f2174945-c9be-4e2a-bd9e-80a5b015772b tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] Calling method '.version_select at 0x7f0b3eb45160>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:29.104670 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-1a2e8d62-993f-4732-a9fc-a1a4a71f62bf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:29.110324 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-1a2e8d62-993f-4732-a9fc-a1a4a71f62bf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:29.117607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1a2e8d62-993f-4732-a9fc-a1a4a71f62bf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:29.118096 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1a2e8d62-993f-4732-a9fc-a1a4a71f62bf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:29.118531 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1a2e8d62-993f-4732-a9fc-a1a4a71f62bf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:29.119218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1a2e8d62-993f-4732-a9fc-a1a4a71f62bf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:29.119697 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1a2e8d62-993f-4732-a9fc-a1a4a71f62bf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:29.120987 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1a2e8d62-993f-4732-a9fc-a1a4a71f62bf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:29.183981 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f2174945-c9be-4e2a-bd9e-80a5b015772b tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099453 Aug 22 05:38:29.184769 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 24/53] 10.222.0.18 () {58 vars in 1155 bytes} [Mon Aug 22 05:38:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:29.196425 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-1a2e8d62-993f-4732-a9fc-a1a4a71f62bf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:29.197835 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-481791b1-b7c9-4297-ad1a-3c41294a59fe tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] Calling method '.version_select at 0x7f0b3eb45a60>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:29.205278 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-1a2e8d62-993f-4732-a9fc-a1a4a71f62bf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1288 microversion: 2.1 time: 0.104742 Aug 22 05:38:29.207897 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 30/54] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:29 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:38:29.284791 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-481791b1-b7c9-4297-ad1a-3c41294a59fe tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090634 Aug 22 05:38:29.285824 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 25/55] 10.222.0.18 () {58 vars in 1188 bytes} [Mon Aug 22 05:38:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:38:29.300602 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f9ee8394-2ca5-47d6-a134-b18272b0f6c6 tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] Calling method '.version_select at 0x7f0b3e337670>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:29.401984 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f9ee8394-2ca5-47d6-a134-b18272b0f6c6 tempest-VolumesTestJSON-1112955262 tempest-VolumesTestJSON-1112955262-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.105105 Aug 22 05:38:29.402610 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 31/56] 10.222.0.18 () {58 vars in 1155 bytes} [Mon Aug 22 05:38:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:29.451689 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a2bb706d-0e1b-4a11-9381-5d8f70ba965b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:29.452307 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a2bb706d-0e1b-4a11-9381-5d8f70ba965b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:29.458862 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2bb706d-0e1b-4a11-9381-5d8f70ba965b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:29.459347 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2bb706d-0e1b-4a11-9381-5d8f70ba965b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:29.459827 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2bb706d-0e1b-4a11-9381-5d8f70ba965b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:29.460833 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2bb706d-0e1b-4a11-9381-5d8f70ba965b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:29.461292 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2bb706d-0e1b-4a11-9381-5d8f70ba965b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:29.461720 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2bb706d-0e1b-4a11-9381-5d8f70ba965b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:29.547053 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a2bb706d-0e1b-4a11-9381-5d8f70ba965b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:29.548404 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a2bb706d-0e1b-4a11-9381-5d8f70ba965b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1285 microversion: 2.1 time: 0.101968 Aug 22 05:38:29.549065 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 26/57] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:29 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:29.960447 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-bc02fe6f-7540-4b80-8416-2903c20fd262 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:29.961084 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-bc02fe6f-7540-4b80-8416-2903c20fd262 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:29.971616 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bc02fe6f-7540-4b80-8416-2903c20fd262 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:29.972122 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bc02fe6f-7540-4b80-8416-2903c20fd262 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:29.972544 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bc02fe6f-7540-4b80-8416-2903c20fd262 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:29.973242 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bc02fe6f-7540-4b80-8416-2903c20fd262 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:29.973686 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bc02fe6f-7540-4b80-8416-2903c20fd262 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:29.974107 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bc02fe6f-7540-4b80-8416-2903c20fd262 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:30.007567 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ab24e68d-39bd-42fa-ac63-1febe40ac8dd tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3eb6cc10>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:30.044324 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-bc02fe6f-7540-4b80-8416-2903c20fd262 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:30.054181 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-bc02fe6f-7540-4b80-8416-2903c20fd262 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1279 microversion: 2.1 time: 0.097546 Aug 22 05:38:30.054761 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 32/58] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:29 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1279 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:30.062025 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ab24e68d-39bd-42fa-ac63-1febe40ac8dd tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2" status: 200 len: 343 microversion: 2.1 time: 0.058339 Aug 22 05:38:30.063183 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 27/59] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 22 05:38:30 2022] GET /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2 => generated 343 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:38:30.233734 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8ed1eef1-5bb6-4f05-b763-ff32a2a389bc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:30.234344 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8ed1eef1-5bb6-4f05-b763-ff32a2a389bc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:30.240684 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8ed1eef1-5bb6-4f05-b763-ff32a2a389bc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:30.243249 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8ed1eef1-5bb6-4f05-b763-ff32a2a389bc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:30.243249 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8ed1eef1-5bb6-4f05-b763-ff32a2a389bc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:30.243249 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8ed1eef1-5bb6-4f05-b763-ff32a2a389bc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:30.243249 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8ed1eef1-5bb6-4f05-b763-ff32a2a389bc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:30.243639 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8ed1eef1-5bb6-4f05-b763-ff32a2a389bc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:30.309879 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8ed1eef1-5bb6-4f05-b763-ff32a2a389bc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:30.317576 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8ed1eef1-5bb6-4f05-b763-ff32a2a389bc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1288 microversion: 2.1 time: 0.088583 Aug 22 05:38:30.318149 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 33/60] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:30 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:30.570435 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2b22cbe8-c7f8-413f-a071-a52b53442c93 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:30.571161 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2b22cbe8-c7f8-413f-a071-a52b53442c93 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:30.578202 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b22cbe8-c7f8-413f-a071-a52b53442c93 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:30.578910 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b22cbe8-c7f8-413f-a071-a52b53442c93 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:30.579423 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b22cbe8-c7f8-413f-a071-a52b53442c93 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:30.580255 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b22cbe8-c7f8-413f-a071-a52b53442c93 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:30.580782 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b22cbe8-c7f8-413f-a071-a52b53442c93 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:30.581330 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b22cbe8-c7f8-413f-a071-a52b53442c93 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:30.650759 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2b22cbe8-c7f8-413f-a071-a52b53442c93 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:30.659108 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2b22cbe8-c7f8-413f-a071-a52b53442c93 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1285 microversion: 2.1 time: 0.093060 Aug 22 05:38:30.659812 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 28/61] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:30 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:31.077586 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c5992762-6b15-4839-a3b0-d9ad01ef3364 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3e3449d0>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:31.078811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0ab76bcf-812d-40c5-a144-2fb078de539e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:31.079458 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0ab76bcf-812d-40c5-a144-2fb078de539e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:31.085985 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0ab76bcf-812d-40c5-a144-2fb078de539e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:31.086484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0ab76bcf-812d-40c5-a144-2fb078de539e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:31.086943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0ab76bcf-812d-40c5-a144-2fb078de539e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:31.087647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0ab76bcf-812d-40c5-a144-2fb078de539e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:31.088126 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0ab76bcf-812d-40c5-a144-2fb078de539e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:31.088557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0ab76bcf-812d-40c5-a144-2fb078de539e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:31.125724 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c5992762-6b15-4839-a3b0-d9ad01ef3364 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2" status: 200 len: 343 microversion: 2.1 time: 0.052192 Aug 22 05:38:31.126287 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 34/62] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 22 05:38:31 2022] GET /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2 => generated 343 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:31.152943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0ab76bcf-812d-40c5-a144-2fb078de539e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:31.160816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0ab76bcf-812d-40c5-a144-2fb078de539e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1279 microversion: 2.1 time: 0.086005 Aug 22 05:38:31.161387 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 29/63] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:31 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1279 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:31.338444 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7056b236-7b15-483c-a18a-e3017b6ea449 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:31.339299 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-7056b236-7b15-483c-a18a-e3017b6ea449 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:31.347329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7056b236-7b15-483c-a18a-e3017b6ea449 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:31.347925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7056b236-7b15-483c-a18a-e3017b6ea449 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:31.348360 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7056b236-7b15-483c-a18a-e3017b6ea449 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:31.349107 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7056b236-7b15-483c-a18a-e3017b6ea449 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:31.349553 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7056b236-7b15-483c-a18a-e3017b6ea449 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:31.349964 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7056b236-7b15-483c-a18a-e3017b6ea449 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:31.412645 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-7056b236-7b15-483c-a18a-e3017b6ea449 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:31.420358 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-7056b236-7b15-483c-a18a-e3017b6ea449 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1288 microversion: 2.1 time: 0.085802 Aug 22 05:38:31.420924 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 35/64] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:31 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:31.685320 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-733ed301-b92e-40c6-86f0-7faa2ae2406e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:31.685915 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-733ed301-b92e-40c6-86f0-7faa2ae2406e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:31.696096 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-733ed301-b92e-40c6-86f0-7faa2ae2406e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:31.696820 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-733ed301-b92e-40c6-86f0-7faa2ae2406e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:31.697388 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-733ed301-b92e-40c6-86f0-7faa2ae2406e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:31.700734 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-733ed301-b92e-40c6-86f0-7faa2ae2406e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:31.702231 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-733ed301-b92e-40c6-86f0-7faa2ae2406e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:31.703088 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-733ed301-b92e-40c6-86f0-7faa2ae2406e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:31.779502 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-733ed301-b92e-40c6-86f0-7faa2ae2406e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:31.789806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-733ed301-b92e-40c6-86f0-7faa2ae2406e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1273 microversion: 2.1 time: 0.112686 Aug 22 05:38:31.790272 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 30/65] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:31 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1273 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:32.140157 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-966d7482-851c-4447-932a-1d13c2f75076 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3e3d9280>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:32.184912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3d0ad093-d707-4a08-a7d0-964f378c77a5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:32.186648 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3d0ad093-d707-4a08-a7d0-964f378c77a5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:32.195258 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3d0ad093-d707-4a08-a7d0-964f378c77a5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:32.195999 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3d0ad093-d707-4a08-a7d0-964f378c77a5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:32.196675 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3d0ad093-d707-4a08-a7d0-964f378c77a5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:32.197791 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3d0ad093-d707-4a08-a7d0-964f378c77a5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:32.198556 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3d0ad093-d707-4a08-a7d0-964f378c77a5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:32.199404 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3d0ad093-d707-4a08-a7d0-964f378c77a5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:32.250280 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-966d7482-851c-4447-932a-1d13c2f75076 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2" status: 200 len: 343 microversion: 2.1 time: 0.113501 Aug 22 05:38:32.250419 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 36/66] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 22 05:38:32 2022] GET /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2 => generated 343 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:32.443510 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-934a1968-305c-40d0-9574-6d45bbfbf37a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:32.444722 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-934a1968-305c-40d0-9574-6d45bbfbf37a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:32.452999 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-934a1968-305c-40d0-9574-6d45bbfbf37a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:32.453912 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-934a1968-305c-40d0-9574-6d45bbfbf37a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:32.454423 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-934a1968-305c-40d0-9574-6d45bbfbf37a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:32.455238 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-934a1968-305c-40d0-9574-6d45bbfbf37a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:32.455735 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3d0ad093-d707-4a08-a7d0-964f378c77a5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:32.455919 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-934a1968-305c-40d0-9574-6d45bbfbf37a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:32.456575 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-934a1968-305c-40d0-9574-6d45bbfbf37a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:32.470489 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3d0ad093-d707-4a08-a7d0-964f378c77a5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1279 microversion: 2.1 time: 0.292291 Aug 22 05:38:32.471083 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 31/67] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:32 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1279 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:32.600222 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-934a1968-305c-40d0-9574-6d45bbfbf37a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:32.611424 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-934a1968-305c-40d0-9574-6d45bbfbf37a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1294 microversion: 2.1 time: 0.173027 Aug 22 05:38:32.616729 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 37/68] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:32 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1294 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:32.816148 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6edb5fb3-80a2-4ca4-b0fe-372ab10939f9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:32.817579 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6edb5fb3-80a2-4ca4-b0fe-372ab10939f9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:32.836853 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6edb5fb3-80a2-4ca4-b0fe-372ab10939f9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:32.837699 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6edb5fb3-80a2-4ca4-b0fe-372ab10939f9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:32.838573 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6edb5fb3-80a2-4ca4-b0fe-372ab10939f9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:32.840010 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6edb5fb3-80a2-4ca4-b0fe-372ab10939f9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:32.847624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6edb5fb3-80a2-4ca4-b0fe-372ab10939f9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:32.848712 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6edb5fb3-80a2-4ca4-b0fe-372ab10939f9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:33.274796 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8c50e55c-b981-4aea-a75f-bfd37fbabc39 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3e337280>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:33.480010 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-8c50e55c-b981-4aea-a75f-bfd37fbabc39 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] HTTP exception thrown: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8c50e55c-b981-4aea-a75f-bfd37fbabc39 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Request method failure captured: Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: GET /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2 HTTP/1.1 Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxZAj3uPctVUyNNYsamCdiCFtvqYoSAXXxQW40XLKD2KpSt1_l7wW0cuO-8tPWPX1Ezyps9bNzrKSwFys3Z14I4aD-dUKMvkVy9OhWBp9XErYbNe1whu8F4yTTwAtFmz-PmMJKnvUIyzFDihwJox-4wRhdB2hLXukWjSP2bRoQ_omH0 Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: c37fd468d46f4348b13b002e26f2ee3a Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-68529632 Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:38:33.483259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:38:33.484766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c37fd468d46f4348b13b002e26f2ee3a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c37fd468d46f4348b13b002e26f2ee3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c37fd468d46f4348b13b002e26f2ee3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c37fd468d46f4348b13b002e26f2ee3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:38:33.484766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-VolumesSnapshotsTestJSON-68529632 Aug 22 05:38:33.484766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: c37fd468d46f4348b13b002e26f2ee3a Aug 22 05:38:33.484766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-68529632 Aug 22 05:38:33.484766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-VolumesSnapshotsTestJSON-68529632-project Aug 22 05:38:33.484766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:38:33.484766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:38:33.484766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: 7395ad97ab494323a7f92ea53b3d910a Aug 22 05:38:33.484766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-VolumesSnapshotsTestJSON-68529632-project Aug 22 05:38:33.484766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: Aug 22 05:38:33.484766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. Aug 22 05:38:33.484766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': '255cbe8e-cedb-4171-84c6-67271f1efde2'} Aug 22 05:38:33.484766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. (HTTP 404) (Request-ID: req-f85bade9-a3ba-46a0-962f-e6e7cf647d4d) Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:38:33.485668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 05:38:33.486886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 05:38:33.488559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:38:33.489827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. Aug 22 05:38:33.489827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:33.489827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:38:33.489827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:33.489827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:33.489827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:38:33.489827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:38:33.489827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:38:33.489827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:38:33.489827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. Aug 22 05:38:33.489827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:33.489827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8c50e55c-b981-4aea-a75f-bfd37fbabc39 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Returning 404 to user: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:38:33.489827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8c50e55c-b981-4aea-a75f-bfd37fbabc39 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2" status: 404 len: 109 microversion: 2.1 time: 0.225411 Aug 22 05:38:33.489827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 38/69] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 22 05:38:33 2022] GET /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2 => generated 109 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:38:33.510524 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-dfde1ea6-71b0-4e41-96df-f102b4616b07 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:33.511205 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-dfde1ea6-71b0-4e41-96df-f102b4616b07 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:33.555411 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dfde1ea6-71b0-4e41-96df-f102b4616b07 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:33.558208 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=4 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:33.560867 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dfde1ea6-71b0-4e41-96df-f102b4616b07 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:33.572808 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dfde1ea6-71b0-4e41-96df-f102b4616b07 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:33.573613 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dfde1ea6-71b0-4e41-96df-f102b4616b07 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:33.574214 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dfde1ea6-71b0-4e41-96df-f102b4616b07 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:33.574643 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dfde1ea6-71b0-4e41-96df-f102b4616b07 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:33.714607 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6edb5fb3-80a2-4ca4-b0fe-372ab10939f9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:33.728263 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6edb5fb3-80a2-4ca4-b0fe-372ab10939f9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.919739 Aug 22 05:38:33.728863 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 32/70] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:32 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:33.746155 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-47e8a8f1-26f0-4875-8d32-7bdb61f4b421 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3eb6c670>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:33.839395 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-47e8a8f1-26f0-4875-8d32-7bdb61f4b421 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] HTTP exception thrown: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-47e8a8f1-26f0-4875-8d32-7bdb61f4b421 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Request method failure captured: Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: DELETE /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2 HTTP/1.1 Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxZAj3uPctVUyNNYsamCdiCFtvqYoSAXXxQW40XLKD2KpSt1_l7wW0cuO-8tPWPX1Ezyps9bNzrKSwFys3Z14I4aD-dUKMvkVy9OhWBp9XErYbNe1whu8F4yTTwAtFmz-PmMJKnvUIyzFDihwJox-4wRhdB2hLXukWjSP2bRoQ_omH0 Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: c37fd468d46f4348b13b002e26f2ee3a Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-68529632 Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:38:33.846792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:38:33.848289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c37fd468d46f4348b13b002e26f2ee3a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c37fd468d46f4348b13b002e26f2ee3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c37fd468d46f4348b13b002e26f2ee3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c37fd468d46f4348b13b002e26f2ee3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:38:33.848289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesSnapshotsTestJSON-68529632 Aug 22 05:38:33.848289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: c37fd468d46f4348b13b002e26f2ee3a Aug 22 05:38:33.848289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-68529632 Aug 22 05:38:33.848289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesSnapshotsTestJSON-68529632-project Aug 22 05:38:33.848289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:38:33.848289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:38:33.848289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 7395ad97ab494323a7f92ea53b3d910a Aug 22 05:38:33.848289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesSnapshotsTestJSON-68529632-project Aug 22 05:38:33.848289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: Aug 22 05:38:33.848289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. Aug 22 05:38:33.848289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '255cbe8e-cedb-4171-84c6-67271f1efde2'} Aug 22 05:38:33.848289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. (HTTP 404) (Request-ID: req-9f0926f3-4f57-47de-a508-80f35374c43f) Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:38:33.848976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 05:38:33.849996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 05:38:33.851014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:38:33.853716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. Aug 22 05:38:33.853716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:38:33.853716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:38:33.853716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:38:33.853716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:33.853716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:38:33.853716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:38:33.853716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:38:33.853716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:38:33.853716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. Aug 22 05:38:33.853716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:38:33.853716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-47e8a8f1-26f0-4875-8d32-7bdb61f4b421 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Returning 404 to user: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:38:33.853716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-47e8a8f1-26f0-4875-8d32-7bdb61f4b421 tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2" status: 404 len: 109 microversion: 2.1 time: 0.119367 Aug 22 05:38:33.853716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 33/71] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 22 05:38:33 2022] DELETE /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:38:33.873260 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-33638b81-381b-4a53-ac0a-260c37477fac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:33.873905 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-33638b81-381b-4a53-ac0a-260c37477fac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:33.916943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33638b81-381b-4a53-ac0a-260c37477fac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:33.917434 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33638b81-381b-4a53-ac0a-260c37477fac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:33.918033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33638b81-381b-4a53-ac0a-260c37477fac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:33.918870 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33638b81-381b-4a53-ac0a-260c37477fac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:33.919316 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33638b81-381b-4a53-ac0a-260c37477fac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:33.929514 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33638b81-381b-4a53-ac0a-260c37477fac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:33.975453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-dfde1ea6-71b0-4e41-96df-f102b4616b07 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:33.985268 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-dfde1ea6-71b0-4e41-96df-f102b4616b07 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1279 microversion: 2.1 time: 0.493041 Aug 22 05:38:34.013844 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 39/72] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:33 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1279 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:34.018893 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-af7c5bf9-82a7-4b92-8dad-f3dadd62aabc tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Calling method '.version_select at 0x7f0b3e337280>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:34.089700 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-33638b81-381b-4a53-ac0a-260c37477fac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:34.118630 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-33638b81-381b-4a53-ac0a-260c37477fac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1294 microversion: 2.1 time: 0.265308 Aug 22 05:38:34.119287 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 34/73] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:33 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1294 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:34.233262 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-af7c5bf9-82a7-4b92-8dad-f3dadd62aabc tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] HTTP exception thrown: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-af7c5bf9-82a7-4b92-8dad-f3dadd62aabc tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Request method failure captured: Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: GET /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2 HTTP/1.1 Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxZAj3uPctVUyNNYsamCdiCFtvqYoSAXXxQW40XLKD2KpSt1_l7wW0cuO-8tPWPX1Ezyps9bNzrKSwFys3Z14I4aD-dUKMvkVy9OhWBp9XErYbNe1whu8F4yTTwAtFmz-PmMJKnvUIyzFDihwJox-4wRhdB2hLXukWjSP2bRoQ_omH0 Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: c37fd468d46f4348b13b002e26f2ee3a Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-68529632 Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:38:34.235276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:38:34.236820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c37fd468d46f4348b13b002e26f2ee3a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c37fd468d46f4348b13b002e26f2ee3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c37fd468d46f4348b13b002e26f2ee3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c37fd468d46f4348b13b002e26f2ee3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:38:34.236820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-VolumesSnapshotsTestJSON-68529632 Aug 22 05:38:34.236820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: c37fd468d46f4348b13b002e26f2ee3a Aug 22 05:38:34.236820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-68529632 Aug 22 05:38:34.236820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-VolumesSnapshotsTestJSON-68529632-project Aug 22 05:38:34.236820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:38:34.236820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:38:34.236820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: 7395ad97ab494323a7f92ea53b3d910a Aug 22 05:38:34.236820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-VolumesSnapshotsTestJSON-68529632-project Aug 22 05:38:34.236820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: Aug 22 05:38:34.236820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. Aug 22 05:38:34.236820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': '255cbe8e-cedb-4171-84c6-67271f1efde2'} Aug 22 05:38:34.236820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. (HTTP 404) (Request-ID: req-40b5226a-4542-4b86-b9a9-fa946ab6b19a) Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:38:34.237664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 05:38:34.238906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 05:38:34.240235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:38:34.241410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. Aug 22 05:38:34.241410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:34.241410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:38:34.241410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:34.241410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:38:34.241410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:38:34.241410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:38:34.241410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:38:34.241410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:38:34.241410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. Aug 22 05:38:34.241410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:38:34.241410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-af7c5bf9-82a7-4b92-8dad-f3dadd62aabc tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] Returning 404 to user: Volume 255cbe8e-cedb-4171-84c6-67271f1efde2 could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:38:34.241410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-af7c5bf9-82a7-4b92-8dad-f3dadd62aabc tempest-VolumesSnapshotsTestJSON-68529632 tempest-VolumesSnapshotsTestJSON-68529632-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2" status: 404 len: 109 microversion: 2.1 time: 0.221787 Aug 22 05:38:34.241410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 40/74] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 22 05:38:34 2022] GET /compute/v2.1/os-volumes/255cbe8e-cedb-4171-84c6-67271f1efde2 => generated 109 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:38:34.754074 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-27ff8c56-0f0b-4bb2-8a2e-efbf25cd8af5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:34.755452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-27ff8c56-0f0b-4bb2-8a2e-efbf25cd8af5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:34.767375 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27ff8c56-0f0b-4bb2-8a2e-efbf25cd8af5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:34.768173 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27ff8c56-0f0b-4bb2-8a2e-efbf25cd8af5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:34.768768 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27ff8c56-0f0b-4bb2-8a2e-efbf25cd8af5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:34.769628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27ff8c56-0f0b-4bb2-8a2e-efbf25cd8af5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:34.770207 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27ff8c56-0f0b-4bb2-8a2e-efbf25cd8af5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:34.770790 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27ff8c56-0f0b-4bb2-8a2e-efbf25cd8af5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:35.013844 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-1f0c3f2a-1b1d-4e79-b620-f5df5159ca47 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:35.014618 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-1f0c3f2a-1b1d-4e79-b620-f5df5159ca47 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:35.035560 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1f0c3f2a-1b1d-4e79-b620-f5df5159ca47 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:35.037545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-27ff8c56-0f0b-4bb2-8a2e-efbf25cd8af5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:35.038209 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1f0c3f2a-1b1d-4e79-b620-f5df5159ca47 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:35.039187 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1f0c3f2a-1b1d-4e79-b620-f5df5159ca47 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:35.040751 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1f0c3f2a-1b1d-4e79-b620-f5df5159ca47 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:35.043816 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1f0c3f2a-1b1d-4e79-b620-f5df5159ca47 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:35.044429 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1f0c3f2a-1b1d-4e79-b620-f5df5159ca47 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:35.051565 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-27ff8c56-0f0b-4bb2-8a2e-efbf25cd8af5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.300382 Aug 22 05:38:35.067789 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 35/75] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:34 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:35.146563 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-195ee394-e332-4b3b-b581-829615f939ab tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:35.147625 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-195ee394-e332-4b3b-b581-829615f939ab tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:35.160209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-195ee394-e332-4b3b-b581-829615f939ab tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:35.162480 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-195ee394-e332-4b3b-b581-829615f939ab tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:35.163107 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-195ee394-e332-4b3b-b581-829615f939ab tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:35.165497 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-195ee394-e332-4b3b-b581-829615f939ab tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:35.166226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-195ee394-e332-4b3b-b581-829615f939ab tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:35.167458 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-195ee394-e332-4b3b-b581-829615f939ab tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:35.262671 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-1f0c3f2a-1b1d-4e79-b620-f5df5159ca47 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:35.271219 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-1f0c3f2a-1b1d-4e79-b620-f5df5159ca47 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1279 microversion: 2.1 time: 0.262061 Aug 22 05:38:35.271846 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 41/76] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:35 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1279 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:35.486028 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-195ee394-e332-4b3b-b581-829615f939ab tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:35.497492 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-195ee394-e332-4b3b-b581-829615f939ab tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.356679 Aug 22 05:38:35.498084 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 36/77] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:35 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:35.794938 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-017ea31d-fc25-4566-852d-2b56b34d4219 req-63acbbba-ee88-4f86-a98c-f54b757d9488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ee8e71-810f-4f41-af8a-9bed26135368", "tag": "977bea28-5f40-42b4-ad5a-b1856e7e992b"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:38:35.807419 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-017ea31d-fc25-4566-852d-2b56b34d4219 req-63acbbba-ee88-4f86-a98c-f54b757d9488 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:35.807844 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-017ea31d-fc25-4566-852d-2b56b34d4219 req-63acbbba-ee88-4f86-a98c-f54b757d9488 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:35.808282 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-017ea31d-fc25-4566-852d-2b56b34d4219 req-63acbbba-ee88-4f86-a98c-f54b757d9488 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:35.827888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-017ea31d-fc25-4566-852d-2b56b34d4219 req-63acbbba-ee88-4f86-a98c-f54b757d9488 service nova] Creating event network-changed:977bea28-5f40-42b4-ad5a-b1856e7e992b for instance f8ee8e71-810f-4f41-af8a-9bed26135368 on hv-cinder-85391 Aug 22 05:38:35.828416 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-017ea31d-fc25-4566-852d-2b56b34d4219 req-63acbbba-ee88-4f86-a98c-f54b757d9488 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132497) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 22 05:38:35.828809 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-017ea31d-fc25-4566-852d-2b56b34d4219 req-63acbbba-ee88-4f86-a98c-f54b757d9488 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132497) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 22 05:38:35.829829 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fcebc4a-8488-4477-8a15-d0cbd135d6a4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:35.830281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fcebc4a-8488-4477-8a15-d0cbd135d6a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:35.830703 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fcebc4a-8488-4477-8a15-d0cbd135d6a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:35.831408 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fcebc4a-8488-4477-8a15-d0cbd135d6a4 None None] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:35.831877 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fcebc4a-8488-4477-8a15-d0cbd135d6a4 None None] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:35.832301 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fcebc4a-8488-4477-8a15-d0cbd135d6a4 None None] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:35.841106 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.compute.rpcapi [None req-4fcebc4a-8488-4477-8a15-d0cbd135d6a4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 22 05:38:35.841974 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fcebc4a-8488-4477-8a15-d0cbd135d6a4 None None] Releasing lock "compute-rpcapi-router" {{(pid=132497) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 22 05:38:35.860031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4fcebc4a-8488-4477-8a15-d0cbd135d6a4 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131289 Aug 22 05:38:35.860626 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 42/78] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:36.079254 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-30206946-590d-4bff-9b82-947862db2bdd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:36.079985 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-30206946-590d-4bff-9b82-947862db2bdd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:36.095071 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-30206946-590d-4bff-9b82-947862db2bdd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:36.095691 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-30206946-590d-4bff-9b82-947862db2bdd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:36.096196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-30206946-590d-4bff-9b82-947862db2bdd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:36.096914 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-30206946-590d-4bff-9b82-947862db2bdd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:36.097364 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-30206946-590d-4bff-9b82-947862db2bdd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:36.097788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-30206946-590d-4bff-9b82-947862db2bdd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:36.270684 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-30206946-590d-4bff-9b82-947862db2bdd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:36.278968 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-30206946-590d-4bff-9b82-947862db2bdd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.207075 Aug 22 05:38:36.280479 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 37/79] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:36 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:36.294132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-3f4339ae-a163-4edd-b6f5-ab3f45f6f0c2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:36.294837 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-3f4339ae-a163-4edd-b6f5-ab3f45f6f0c2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:36.301324 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3f4339ae-a163-4edd-b6f5-ab3f45f6f0c2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:36.301810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3f4339ae-a163-4edd-b6f5-ab3f45f6f0c2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:36.302536 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3f4339ae-a163-4edd-b6f5-ab3f45f6f0c2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:36.303460 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3f4339ae-a163-4edd-b6f5-ab3f45f6f0c2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:36.304092 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3f4339ae-a163-4edd-b6f5-ab3f45f6f0c2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:36.304648 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3f4339ae-a163-4edd-b6f5-ab3f45f6f0c2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:36.488001 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-3f4339ae-a163-4edd-b6f5-ab3f45f6f0c2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:36.499407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-3f4339ae-a163-4edd-b6f5-ab3f45f6f0c2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.209753 Aug 22 05:38:36.500025 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 43/80] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:36 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:36.523313 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-84847aa2-23ae-4c38-9709-2fd4584753fb tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:36.525638 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-84847aa2-23ae-4c38-9709-2fd4584753fb tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:36.537285 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84847aa2-23ae-4c38-9709-2fd4584753fb tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:36.538075 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84847aa2-23ae-4c38-9709-2fd4584753fb tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:36.538667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84847aa2-23ae-4c38-9709-2fd4584753fb tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:36.539730 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84847aa2-23ae-4c38-9709-2fd4584753fb tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:36.540470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84847aa2-23ae-4c38-9709-2fd4584753fb tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:36.541386 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84847aa2-23ae-4c38-9709-2fd4584753fb tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:36.717366 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-84847aa2-23ae-4c38-9709-2fd4584753fb tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:36.757303 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-84847aa2-23ae-4c38-9709-2fd4584753fb tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.239102 Aug 22 05:38:36.757933 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 38/81] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:36 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:38:37.300646 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-018652c0-5b13-4ea2-b3e4-7688e40d36c0 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:37.301273 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-018652c0-5b13-4ea2-b3e4-7688e40d36c0 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:37.304370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=24 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:37.307791 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-018652c0-5b13-4ea2-b3e4-7688e40d36c0 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:37.308314 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-018652c0-5b13-4ea2-b3e4-7688e40d36c0 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:37.308866 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-018652c0-5b13-4ea2-b3e4-7688e40d36c0 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:37.309559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-018652c0-5b13-4ea2-b3e4-7688e40d36c0 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:37.310020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-018652c0-5b13-4ea2-b3e4-7688e40d36c0 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:37.310410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-018652c0-5b13-4ea2-b3e4-7688e40d36c0 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:37.454038 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-018652c0-5b13-4ea2-b3e4-7688e40d36c0 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:37.461749 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-018652c0-5b13-4ea2-b3e4-7688e40d36c0 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.164866 Aug 22 05:38:37.462318 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 44/82] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:37 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:37.521585 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d7cabd77-0442-454e-b233-9b45dea43dfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:37.522180 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d7cabd77-0442-454e-b233-9b45dea43dfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:37.524017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=14 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:37.529464 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7cabd77-0442-454e-b233-9b45dea43dfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:37.530160 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7cabd77-0442-454e-b233-9b45dea43dfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:37.530730 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7cabd77-0442-454e-b233-9b45dea43dfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:37.531412 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7cabd77-0442-454e-b233-9b45dea43dfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:37.531878 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7cabd77-0442-454e-b233-9b45dea43dfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:37.532316 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7cabd77-0442-454e-b233-9b45dea43dfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:37.695895 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d7cabd77-0442-454e-b233-9b45dea43dfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:37.699394 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:37.704852 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d7cabd77-0442-454e-b233-9b45dea43dfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.187157 Aug 22 05:38:37.705427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 39/83] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:37 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:37.778446 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-d86fde52-5d1a-43ac-8e5c-923a1364c6d4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:37.779071 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-d86fde52-5d1a-43ac-8e5c-923a1364c6d4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:37.785514 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d86fde52-5d1a-43ac-8e5c-923a1364c6d4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:37.785992 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d86fde52-5d1a-43ac-8e5c-923a1364c6d4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:37.786593 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d86fde52-5d1a-43ac-8e5c-923a1364c6d4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:37.787290 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d86fde52-5d1a-43ac-8e5c-923a1364c6d4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:37.787776 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d86fde52-5d1a-43ac-8e5c-923a1364c6d4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:37.788198 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d86fde52-5d1a-43ac-8e5c-923a1364c6d4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:37.935287 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-d86fde52-5d1a-43ac-8e5c-923a1364c6d4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:37.943172 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-d86fde52-5d1a-43ac-8e5c-923a1364c6d4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.168686 Aug 22 05:38:37.943769 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 45/84] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:37 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:38.483950 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0b1f526d-a318-48e0-8f45-2a46bb7725eb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:38.484467 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0b1f526d-a318-48e0-8f45-2a46bb7725eb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:38.491206 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b1f526d-a318-48e0-8f45-2a46bb7725eb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:38.491722 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b1f526d-a318-48e0-8f45-2a46bb7725eb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:38.492156 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b1f526d-a318-48e0-8f45-2a46bb7725eb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:38.492839 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b1f526d-a318-48e0-8f45-2a46bb7725eb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:38.493285 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b1f526d-a318-48e0-8f45-2a46bb7725eb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:38.493703 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b1f526d-a318-48e0-8f45-2a46bb7725eb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:38.633293 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0b1f526d-a318-48e0-8f45-2a46bb7725eb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:38.647907 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0b1f526d-a318-48e0-8f45-2a46bb7725eb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.168355 Aug 22 05:38:38.651616 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 40/85] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:38 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:38.728471 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-dc107cbd-9b41-45b9-b74f-6104f652e60e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:38.729308 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-dc107cbd-9b41-45b9-b74f-6104f652e60e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:38.735247 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:38.737430 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc107cbd-9b41-45b9-b74f-6104f652e60e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:38.737920 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc107cbd-9b41-45b9-b74f-6104f652e60e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:38.738546 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc107cbd-9b41-45b9-b74f-6104f652e60e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:38.739435 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc107cbd-9b41-45b9-b74f-6104f652e60e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:38.739948 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc107cbd-9b41-45b9-b74f-6104f652e60e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:38.740376 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc107cbd-9b41-45b9-b74f-6104f652e60e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:38.746504 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=100 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:38.879695 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-dc107cbd-9b41-45b9-b74f-6104f652e60e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:38.887667 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-dc107cbd-9b41-45b9-b74f-6104f652e60e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.164595 Aug 22 05:38:38.904595 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 46/86] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:38 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:38.964479 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-150c8a80-8be5-4cea-a62c-9c961c1d506f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:38.965080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-150c8a80-8be5-4cea-a62c-9c961c1d506f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:38.972019 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-150c8a80-8be5-4cea-a62c-9c961c1d506f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:38.972486 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-150c8a80-8be5-4cea-a62c-9c961c1d506f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:38.972920 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-150c8a80-8be5-4cea-a62c-9c961c1d506f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:38.973597 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-150c8a80-8be5-4cea-a62c-9c961c1d506f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:38.974039 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-150c8a80-8be5-4cea-a62c-9c961c1d506f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:38.974451 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-150c8a80-8be5-4cea-a62c-9c961c1d506f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:39.105822 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-150c8a80-8be5-4cea-a62c-9c961c1d506f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:39.113652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-150c8a80-8be5-4cea-a62c-9c961c1d506f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.153130 Aug 22 05:38:39.114222 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 41/87] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:38 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:39.672008 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-dfa4ad15-a97a-45e3-adf3-add7ffcab907 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:39.672766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-dfa4ad15-a97a-45e3-adf3-add7ffcab907 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:39.679214 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dfa4ad15-a97a-45e3-adf3-add7ffcab907 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:39.679996 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dfa4ad15-a97a-45e3-adf3-add7ffcab907 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:39.680619 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dfa4ad15-a97a-45e3-adf3-add7ffcab907 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:39.681515 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dfa4ad15-a97a-45e3-adf3-add7ffcab907 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:39.682488 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dfa4ad15-a97a-45e3-adf3-add7ffcab907 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:39.683100 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dfa4ad15-a97a-45e3-adf3-add7ffcab907 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:39.884118 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-dfa4ad15-a97a-45e3-adf3-add7ffcab907 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:39.893212 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-dfa4ad15-a97a-45e3-adf3-add7ffcab907 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.225299 Aug 22 05:38:39.893811 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 47/88] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:39 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:39.914835 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e06d3eca-68eb-417c-aada-8b5f9430f1a7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:39.916444 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e06d3eca-68eb-417c-aada-8b5f9430f1a7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:39.925519 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e06d3eca-68eb-417c-aada-8b5f9430f1a7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:39.926296 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e06d3eca-68eb-417c-aada-8b5f9430f1a7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:39.926895 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e06d3eca-68eb-417c-aada-8b5f9430f1a7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:39.927994 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e06d3eca-68eb-417c-aada-8b5f9430f1a7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:39.928660 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e06d3eca-68eb-417c-aada-8b5f9430f1a7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:39.929347 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e06d3eca-68eb-417c-aada-8b5f9430f1a7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:40.134338 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-dd3323b9-692f-4d36-8096-e3baa4730193 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:40.134936 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-dd3323b9-692f-4d36-8096-e3baa4730193 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:40.141811 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd3323b9-692f-4d36-8096-e3baa4730193 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:40.142348 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd3323b9-692f-4d36-8096-e3baa4730193 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:40.142792 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd3323b9-692f-4d36-8096-e3baa4730193 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:40.143494 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd3323b9-692f-4d36-8096-e3baa4730193 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:40.143971 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd3323b9-692f-4d36-8096-e3baa4730193 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:40.144426 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd3323b9-692f-4d36-8096-e3baa4730193 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:40.173644 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e06d3eca-68eb-417c-aada-8b5f9430f1a7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:40.181898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e06d3eca-68eb-417c-aada-8b5f9430f1a7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.272881 Aug 22 05:38:40.182470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 42/89] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:39 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:40.297554 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-dd3323b9-692f-4d36-8096-e3baa4730193 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:40.305945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-dd3323b9-692f-4d36-8096-e3baa4730193 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.175247 Aug 22 05:38:40.306512 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 48/90] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:40 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:38:40.918710 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ab4a0ffc-a282-4075-839b-ce9275b7716b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:40.921059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ab4a0ffc-a282-4075-839b-ce9275b7716b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:40.931305 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab4a0ffc-a282-4075-839b-ce9275b7716b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:40.932150 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab4a0ffc-a282-4075-839b-ce9275b7716b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:40.932821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab4a0ffc-a282-4075-839b-ce9275b7716b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:40.933927 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab4a0ffc-a282-4075-839b-ce9275b7716b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:40.934655 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab4a0ffc-a282-4075-839b-ce9275b7716b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:40.951921 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab4a0ffc-a282-4075-839b-ce9275b7716b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:41.203447 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-617c4543-b1a3-4d88-954a-3cc27442da48 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:41.204243 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-617c4543-b1a3-4d88-954a-3cc27442da48 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:41.206061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ab4a0ffc-a282-4075-839b-ce9275b7716b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:41.211007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-617c4543-b1a3-4d88-954a-3cc27442da48 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:41.212111 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-617c4543-b1a3-4d88-954a-3cc27442da48 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:41.214322 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ab4a0ffc-a282-4075-839b-ce9275b7716b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.301811 Aug 22 05:38:41.215557 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-617c4543-b1a3-4d88-954a-3cc27442da48 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:41.216642 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 43/91] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:40 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:41.231711 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-617c4543-b1a3-4d88-954a-3cc27442da48 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:41.243276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-617c4543-b1a3-4d88-954a-3cc27442da48 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:41.243966 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-617c4543-b1a3-4d88-954a-3cc27442da48 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:41.330322 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2f87184c-973c-48bf-86c9-b2acff0b2fa6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:41.331636 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2f87184c-973c-48bf-86c9-b2acff0b2fa6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:41.345333 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2f87184c-973c-48bf-86c9-b2acff0b2fa6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:41.346051 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2f87184c-973c-48bf-86c9-b2acff0b2fa6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:41.348569 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2f87184c-973c-48bf-86c9-b2acff0b2fa6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:41.349534 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2f87184c-973c-48bf-86c9-b2acff0b2fa6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:41.352782 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2f87184c-973c-48bf-86c9-b2acff0b2fa6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:41.353652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2f87184c-973c-48bf-86c9-b2acff0b2fa6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:41.741085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-617c4543-b1a3-4d88-954a-3cc27442da48 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:41.757470 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-617c4543-b1a3-4d88-954a-3cc27442da48 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.557382 Aug 22 05:38:41.772087 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 49/92] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:41 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:41.804592 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2f87184c-973c-48bf-86c9-b2acff0b2fa6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:41.818220 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2f87184c-973c-48bf-86c9-b2acff0b2fa6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.493797 Aug 22 05:38:41.833684 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 44/93] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:41 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:42.238320 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c07d8901-16e6-4752-b920-f7ccead26d51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:42.238926 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c07d8901-16e6-4752-b920-f7ccead26d51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:42.246633 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c07d8901-16e6-4752-b920-f7ccead26d51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:42.247116 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c07d8901-16e6-4752-b920-f7ccead26d51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:42.247552 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c07d8901-16e6-4752-b920-f7ccead26d51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:42.248270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c07d8901-16e6-4752-b920-f7ccead26d51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:42.248804 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c07d8901-16e6-4752-b920-f7ccead26d51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:42.249213 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c07d8901-16e6-4752-b920-f7ccead26d51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:42.416185 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c07d8901-16e6-4752-b920-f7ccead26d51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:42.432739 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c07d8901-16e6-4752-b920-f7ccead26d51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.198025 Aug 22 05:38:42.434356 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 50/94] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:42 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:42.779932 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-22821380-277c-4b59-92cb-7a6cb6e9c632 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:42.780949 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-22821380-277c-4b59-92cb-7a6cb6e9c632 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:42.789146 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22821380-277c-4b59-92cb-7a6cb6e9c632 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:42.789719 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22821380-277c-4b59-92cb-7a6cb6e9c632 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:42.790219 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22821380-277c-4b59-92cb-7a6cb6e9c632 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:42.791193 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22821380-277c-4b59-92cb-7a6cb6e9c632 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:42.791971 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22821380-277c-4b59-92cb-7a6cb6e9c632 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:42.792900 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22821380-277c-4b59-92cb-7a6cb6e9c632 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:42.846648 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5494ca68-b6a9-4b80-a26f-b653eb4a910d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:42.847418 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5494ca68-b6a9-4b80-a26f-b653eb4a910d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:42.853892 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5494ca68-b6a9-4b80-a26f-b653eb4a910d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:42.854761 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5494ca68-b6a9-4b80-a26f-b653eb4a910d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:42.855406 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5494ca68-b6a9-4b80-a26f-b653eb4a910d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:42.856341 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5494ca68-b6a9-4b80-a26f-b653eb4a910d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:42.856965 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5494ca68-b6a9-4b80-a26f-b653eb4a910d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:42.857556 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5494ca68-b6a9-4b80-a26f-b653eb4a910d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:43.065631 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-22821380-277c-4b59-92cb-7a6cb6e9c632 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:43.084925 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-22821380-277c-4b59-92cb-7a6cb6e9c632 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.309882 Aug 22 05:38:43.088281 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 45/95] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:42 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:43.130741 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5494ca68-b6a9-4b80-a26f-b653eb4a910d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:43.146603 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5494ca68-b6a9-4b80-a26f-b653eb4a910d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.303033 Aug 22 05:38:43.149034 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 51/96] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:42 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:43.455721 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e78779de-4f44-4438-9873-020f89e82ca3 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:43.456609 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e78779de-4f44-4438-9873-020f89e82ca3 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:43.468607 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e78779de-4f44-4438-9873-020f89e82ca3 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:43.471103 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e78779de-4f44-4438-9873-020f89e82ca3 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:43.471843 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e78779de-4f44-4438-9873-020f89e82ca3 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:43.474299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e78779de-4f44-4438-9873-020f89e82ca3 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:43.475223 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e78779de-4f44-4438-9873-020f89e82ca3 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:43.476869 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e78779de-4f44-4438-9873-020f89e82ca3 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:43.735950 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e78779de-4f44-4438-9873-020f89e82ca3 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:43.757881 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e78779de-4f44-4438-9873-020f89e82ca3 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.306678 Aug 22 05:38:43.766577 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 46/97] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:43 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:44.112277 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0b2f85cc-22fa-4839-b50f-1f0b439ec8f0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:44.114916 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0b2f85cc-22fa-4839-b50f-1f0b439ec8f0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:44.121299 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0b2f85cc-22fa-4839-b50f-1f0b439ec8f0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:44.121780 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0b2f85cc-22fa-4839-b50f-1f0b439ec8f0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:44.122203 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0b2f85cc-22fa-4839-b50f-1f0b439ec8f0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:44.122880 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0b2f85cc-22fa-4839-b50f-1f0b439ec8f0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:44.123562 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0b2f85cc-22fa-4839-b50f-1f0b439ec8f0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:44.124065 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0b2f85cc-22fa-4839-b50f-1f0b439ec8f0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:44.168310 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-631ae1ee-114c-4a52-9847-e26803c6c778 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:44.169620 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-631ae1ee-114c-4a52-9847-e26803c6c778 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:44.182829 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-631ae1ee-114c-4a52-9847-e26803c6c778 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:44.183324 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-631ae1ee-114c-4a52-9847-e26803c6c778 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:44.183963 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-631ae1ee-114c-4a52-9847-e26803c6c778 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:44.184834 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-631ae1ee-114c-4a52-9847-e26803c6c778 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:44.185436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-631ae1ee-114c-4a52-9847-e26803c6c778 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:44.186047 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-631ae1ee-114c-4a52-9847-e26803c6c778 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:44.335813 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0b2f85cc-22fa-4839-b50f-1f0b439ec8f0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:44.347637 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0b2f85cc-22fa-4839-b50f-1f0b439ec8f0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.240117 Aug 22 05:38:44.349144 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 52/98] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:44 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:44.399176 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-631ae1ee-114c-4a52-9847-e26803c6c778 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:44.407209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-631ae1ee-114c-4a52-9847-e26803c6c778 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.243029 Aug 22 05:38:44.407946 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 47/99] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:44 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:44.785892 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-17dc6553-ba50-4a01-9e27-bdd0e4ef81ea tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:44.786463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-17dc6553-ba50-4a01-9e27-bdd0e4ef81ea tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:44.794458 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-17dc6553-ba50-4a01-9e27-bdd0e4ef81ea tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:44.798184 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-17dc6553-ba50-4a01-9e27-bdd0e4ef81ea tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:44.799832 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-17dc6553-ba50-4a01-9e27-bdd0e4ef81ea tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:44.800289 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-17dc6553-ba50-4a01-9e27-bdd0e4ef81ea tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:44.800744 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-17dc6553-ba50-4a01-9e27-bdd0e4ef81ea tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:44.801164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-17dc6553-ba50-4a01-9e27-bdd0e4ef81ea tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:44.945504 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-17dc6553-ba50-4a01-9e27-bdd0e4ef81ea tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:44.963325 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-17dc6553-ba50-4a01-9e27-bdd0e4ef81ea tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.181704 Aug 22 05:38:44.966828 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 53/100] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:44 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:45.374072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9fa6a0fa-c2a0-446d-a6c3-efe53fe1307c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:45.374072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9fa6a0fa-c2a0-446d-a6c3-efe53fe1307c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:45.377612 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fa6a0fa-c2a0-446d-a6c3-efe53fe1307c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:45.378023 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fa6a0fa-c2a0-446d-a6c3-efe53fe1307c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:45.378461 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fa6a0fa-c2a0-446d-a6c3-efe53fe1307c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:45.379254 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fa6a0fa-c2a0-446d-a6c3-efe53fe1307c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:45.379703 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fa6a0fa-c2a0-446d-a6c3-efe53fe1307c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:45.380121 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fa6a0fa-c2a0-446d-a6c3-efe53fe1307c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:45.432578 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5f1549f1-9c53-4e3a-a2d8-1dac832f9cec tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:45.433180 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5f1549f1-9c53-4e3a-a2d8-1dac832f9cec tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:45.451058 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f1549f1-9c53-4e3a-a2d8-1dac832f9cec tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:45.451637 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f1549f1-9c53-4e3a-a2d8-1dac832f9cec tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:45.452250 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f1549f1-9c53-4e3a-a2d8-1dac832f9cec tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:45.453123 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f1549f1-9c53-4e3a-a2d8-1dac832f9cec tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:45.453714 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f1549f1-9c53-4e3a-a2d8-1dac832f9cec tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:45.454279 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f1549f1-9c53-4e3a-a2d8-1dac832f9cec tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:45.644114 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9fa6a0fa-c2a0-446d-a6c3-efe53fe1307c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:45.669484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9fa6a0fa-c2a0-446d-a6c3-efe53fe1307c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.302932 Aug 22 05:38:45.673067 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 48/101] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:45 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:45.788828 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5f1549f1-9c53-4e3a-a2d8-1dac832f9cec tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:45.798799 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5f1549f1-9c53-4e3a-a2d8-1dac832f9cec tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.370030 Aug 22 05:38:45.799982 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 54/102] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:45 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:45.989162 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-647016f7-9403-46df-8c92-328a288ca543 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:45.989740 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-647016f7-9403-46df-8c92-328a288ca543 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:46.000541 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-647016f7-9403-46df-8c92-328a288ca543 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:46.001294 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-647016f7-9403-46df-8c92-328a288ca543 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:46.001883 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-647016f7-9403-46df-8c92-328a288ca543 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:46.002735 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-647016f7-9403-46df-8c92-328a288ca543 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:46.003336 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-647016f7-9403-46df-8c92-328a288ca543 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:46.003929 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-647016f7-9403-46df-8c92-328a288ca543 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:46.218686 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-647016f7-9403-46df-8c92-328a288ca543 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:46.227489 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-647016f7-9403-46df-8c92-328a288ca543 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.242880 Aug 22 05:38:46.228111 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 49/103] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:45 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:38:46.696580 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-98307912-b4bb-470c-90c6-f90b7b3b3518 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:46.697953 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-98307912-b4bb-470c-90c6-f90b7b3b3518 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:46.700334 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=6 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:46.710213 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-98307912-b4bb-470c-90c6-f90b7b3b3518 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:46.710685 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-98307912-b4bb-470c-90c6-f90b7b3b3518 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:46.711307 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-98307912-b4bb-470c-90c6-f90b7b3b3518 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:46.712231 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-98307912-b4bb-470c-90c6-f90b7b3b3518 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:46.712683 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-98307912-b4bb-470c-90c6-f90b7b3b3518 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:46.713110 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-98307912-b4bb-470c-90c6-f90b7b3b3518 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:46.824106 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-affbcd8c-6756-443d-a96e-b082e22c0807 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:46.824864 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-affbcd8c-6756-443d-a96e-b082e22c0807 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:46.833197 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-affbcd8c-6756-443d-a96e-b082e22c0807 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:46.833685 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-affbcd8c-6756-443d-a96e-b082e22c0807 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:46.834368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-affbcd8c-6756-443d-a96e-b082e22c0807 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:46.835176 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-affbcd8c-6756-443d-a96e-b082e22c0807 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:46.835641 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-affbcd8c-6756-443d-a96e-b082e22c0807 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:46.836114 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-affbcd8c-6756-443d-a96e-b082e22c0807 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:46.917311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-98307912-b4bb-470c-90c6-f90b7b3b3518 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:46.925427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-98307912-b4bb-470c-90c6-f90b7b3b3518 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.232497 Aug 22 05:38:46.925957 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 55/104] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:46 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:47.031717 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-affbcd8c-6756-443d-a96e-b082e22c0807 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:47.044576 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-affbcd8c-6756-443d-a96e-b082e22c0807 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.224856 Aug 22 05:38:47.045324 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 50/105] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:46 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:38:47.260050 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-26557895-a182-488f-b364-f15d7d38d5c9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:47.260781 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-26557895-a182-488f-b364-f15d7d38d5c9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:47.268306 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26557895-a182-488f-b364-f15d7d38d5c9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:47.268934 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26557895-a182-488f-b364-f15d7d38d5c9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:47.269389 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26557895-a182-488f-b364-f15d7d38d5c9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:47.270067 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26557895-a182-488f-b364-f15d7d38d5c9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:47.270508 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26557895-a182-488f-b364-f15d7d38d5c9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:47.270950 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26557895-a182-488f-b364-f15d7d38d5c9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:47.432645 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-26557895-a182-488f-b364-f15d7d38d5c9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:47.441445 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-26557895-a182-488f-b364-f15d7d38d5c9 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.189425 Aug 22 05:38:47.442081 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 56/106] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:47 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:47.947700 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-34ea893a-7d93-47a6-bb2c-87c7ad9fa618 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:47.948956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-34ea893a-7d93-47a6-bb2c-87c7ad9fa618 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:47.955380 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34ea893a-7d93-47a6-bb2c-87c7ad9fa618 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:47.955891 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34ea893a-7d93-47a6-bb2c-87c7ad9fa618 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:47.956422 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34ea893a-7d93-47a6-bb2c-87c7ad9fa618 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:47.957124 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34ea893a-7d93-47a6-bb2c-87c7ad9fa618 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:47.957573 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34ea893a-7d93-47a6-bb2c-87c7ad9fa618 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:47.957925 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34ea893a-7d93-47a6-bb2c-87c7ad9fa618 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:48.073180 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-377ff11d-5077-418b-8890-9d83ed4c764f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:48.073949 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-377ff11d-5077-418b-8890-9d83ed4c764f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:48.080562 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-377ff11d-5077-418b-8890-9d83ed4c764f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:48.081041 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-377ff11d-5077-418b-8890-9d83ed4c764f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:48.081465 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-377ff11d-5077-418b-8890-9d83ed4c764f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:48.082150 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-377ff11d-5077-418b-8890-9d83ed4c764f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:48.083281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-377ff11d-5077-418b-8890-9d83ed4c764f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:48.083616 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-377ff11d-5077-418b-8890-9d83ed4c764f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:48.116425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-34ea893a-7d93-47a6-bb2c-87c7ad9fa618 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:48.129951 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-34ea893a-7d93-47a6-bb2c-87c7ad9fa618 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.186309 Aug 22 05:38:48.130974 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 51/107] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:47 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:48.248180 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-377ff11d-5077-418b-8890-9d83ed4c764f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:48.256522 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-377ff11d-5077-418b-8890-9d83ed4c764f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.187691 Aug 22 05:38:48.257342 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 57/108] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:48 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:48.464707 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0a68827b-1ac7-4f0e-b7df-9004c213fc1f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:48.464707 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0a68827b-1ac7-4f0e-b7df-9004c213fc1f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:48.472105 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a68827b-1ac7-4f0e-b7df-9004c213fc1f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:48.472909 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a68827b-1ac7-4f0e-b7df-9004c213fc1f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:48.473668 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a68827b-1ac7-4f0e-b7df-9004c213fc1f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:48.477387 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a68827b-1ac7-4f0e-b7df-9004c213fc1f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:48.477986 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a68827b-1ac7-4f0e-b7df-9004c213fc1f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:48.478668 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a68827b-1ac7-4f0e-b7df-9004c213fc1f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:48.622838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0a68827b-1ac7-4f0e-b7df-9004c213fc1f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:48.633001 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0a68827b-1ac7-4f0e-b7df-9004c213fc1f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.174266 Aug 22 05:38:48.633982 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 52/109] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:48 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:49.150433 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-9fd32c54-40f2-4e27-8c81-23149f304ef0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:49.151692 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-9fd32c54-40f2-4e27-8c81-23149f304ef0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:49.158346 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9fd32c54-40f2-4e27-8c81-23149f304ef0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:49.158987 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9fd32c54-40f2-4e27-8c81-23149f304ef0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:49.159621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9fd32c54-40f2-4e27-8c81-23149f304ef0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:49.160458 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9fd32c54-40f2-4e27-8c81-23149f304ef0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:49.161034 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9fd32c54-40f2-4e27-8c81-23149f304ef0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:49.161576 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9fd32c54-40f2-4e27-8c81-23149f304ef0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:49.278362 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-949a07ec-95b3-4c2c-ad37-7b67dea8bed6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:49.279115 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-949a07ec-95b3-4c2c-ad37-7b67dea8bed6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:49.282017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:49.288604 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-949a07ec-95b3-4c2c-ad37-7b67dea8bed6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:49.289376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-949a07ec-95b3-4c2c-ad37-7b67dea8bed6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:49.290025 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-949a07ec-95b3-4c2c-ad37-7b67dea8bed6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:49.290945 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-949a07ec-95b3-4c2c-ad37-7b67dea8bed6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:49.291611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-949a07ec-95b3-4c2c-ad37-7b67dea8bed6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:49.292209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-949a07ec-95b3-4c2c-ad37-7b67dea8bed6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:49.609997 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-9fd32c54-40f2-4e27-8c81-23149f304ef0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:49.624501 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-9fd32c54-40f2-4e27-8c81-23149f304ef0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.476418 Aug 22 05:38:49.637892 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 58/110] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:49 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:38:49.654492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-fcc0800e-eb59-4bb9-b3a1-57ea75af0f05 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:49.655913 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-fcc0800e-eb59-4bb9-b3a1-57ea75af0f05 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:49.662713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fcc0800e-eb59-4bb9-b3a1-57ea75af0f05 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:49.663446 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fcc0800e-eb59-4bb9-b3a1-57ea75af0f05 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:49.664064 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fcc0800e-eb59-4bb9-b3a1-57ea75af0f05 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:49.664909 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fcc0800e-eb59-4bb9-b3a1-57ea75af0f05 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:49.665550 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fcc0800e-eb59-4bb9-b3a1-57ea75af0f05 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:49.666150 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fcc0800e-eb59-4bb9-b3a1-57ea75af0f05 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:49.994531 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-949a07ec-95b3-4c2c-ad37-7b67dea8bed6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:50.007553 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-949a07ec-95b3-4c2c-ad37-7b67dea8bed6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.733263 Aug 22 05:38:50.020727 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 53/111] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:49 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:50.204061 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-fcc0800e-eb59-4bb9-b3a1-57ea75af0f05 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:50.216025 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-fcc0800e-eb59-4bb9-b3a1-57ea75af0f05 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.565938 Aug 22 05:38:50.216690 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 59/112] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:49 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:50.646101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f58df8f3-524e-44b4-aafe-36deaa001f7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:50.647205 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f58df8f3-524e-44b4-aafe-36deaa001f7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:50.668054 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f58df8f3-524e-44b4-aafe-36deaa001f7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:50.673524 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f58df8f3-524e-44b4-aafe-36deaa001f7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:50.674512 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f58df8f3-524e-44b4-aafe-36deaa001f7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:50.675556 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f58df8f3-524e-44b4-aafe-36deaa001f7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:50.676282 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f58df8f3-524e-44b4-aafe-36deaa001f7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:50.677169 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f58df8f3-524e-44b4-aafe-36deaa001f7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:51.021739 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-b77aa5df-b6b0-4f94-8c21-30e85f0e23c3 req-06b2a780-48b9-4359-aa02-2af15b768bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02b0897c-3b82-4926-909a-2c34fbcd2a1a", "tag": "c621e300-a2f5-4edd-a7c7-b4bf9b5a2cd7"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:38:51.047376 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b77aa5df-b6b0-4f94-8c21-30e85f0e23c3 req-06b2a780-48b9-4359-aa02-2af15b768bf3 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:51.048796 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b77aa5df-b6b0-4f94-8c21-30e85f0e23c3 req-06b2a780-48b9-4359-aa02-2af15b768bf3 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:51.050882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b77aa5df-b6b0-4f94-8c21-30e85f0e23c3 req-06b2a780-48b9-4359-aa02-2af15b768bf3 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:51.081714 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-b77aa5df-b6b0-4f94-8c21-30e85f0e23c3 req-06b2a780-48b9-4359-aa02-2af15b768bf3 service nova] Creating event network-changed:c621e300-a2f5-4edd-a7c7-b4bf9b5a2cd7 for instance 02b0897c-3b82-4926-909a-2c34fbcd2a1a on hv-cinder-85391 Aug 22 05:38:51.094925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-b77aa5df-b6b0-4f94-8c21-30e85f0e23c3 req-06b2a780-48b9-4359-aa02-2af15b768bf3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076453 Aug 22 05:38:51.098761 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 60/113] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:38:51.113951 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8460680f-ab91-4365-a0cc-19f28cacbbad tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:51.115314 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8460680f-ab91-4365-a0cc-19f28cacbbad tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:51.135036 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8460680f-ab91-4365-a0cc-19f28cacbbad tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:51.135568 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8460680f-ab91-4365-a0cc-19f28cacbbad tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:51.136027 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8460680f-ab91-4365-a0cc-19f28cacbbad tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:51.136756 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8460680f-ab91-4365-a0cc-19f28cacbbad tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:51.137197 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8460680f-ab91-4365-a0cc-19f28cacbbad tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:51.137604 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8460680f-ab91-4365-a0cc-19f28cacbbad tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:51.313566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f58df8f3-524e-44b4-aafe-36deaa001f7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:51.335144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f58df8f3-524e-44b4-aafe-36deaa001f7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.692955 Aug 22 05:38:51.336189 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 54/114] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:50 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:51.407852 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8460680f-ab91-4365-a0cc-19f28cacbbad tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:51.417851 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8460680f-ab91-4365-a0cc-19f28cacbbad tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.316625 Aug 22 05:38:51.418986 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 61/115] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:51 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:51.424784 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-1fe37748-d59d-4e5d-ab06-ff3a6c34c51f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:51.425392 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-1fe37748-d59d-4e5d-ab06-ff3a6c34c51f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:51.431298 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1fe37748-d59d-4e5d-ab06-ff3a6c34c51f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:51.432000 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1fe37748-d59d-4e5d-ab06-ff3a6c34c51f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:51.432529 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1fe37748-d59d-4e5d-ab06-ff3a6c34c51f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:51.433213 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1fe37748-d59d-4e5d-ab06-ff3a6c34c51f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:51.433673 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1fe37748-d59d-4e5d-ab06-ff3a6c34c51f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:51.434071 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1fe37748-d59d-4e5d-ab06-ff3a6c34c51f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:51.560139 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-c06ba3af-c33c-4408-b049-7d1ca29f52e6 req-0a831333-21cb-418b-b3d3-c55f3daaf07b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09fac986-176b-43b6-a4c4-c32b1513a3bf", "tag": "11155cdc-4e7d-4c79-b482-df219fb67393"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:38:51.579728 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c06ba3af-c33c-4408-b049-7d1ca29f52e6 req-0a831333-21cb-418b-b3d3-c55f3daaf07b service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:51.581110 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c06ba3af-c33c-4408-b049-7d1ca29f52e6 req-0a831333-21cb-418b-b3d3-c55f3daaf07b service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:51.582114 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c06ba3af-c33c-4408-b049-7d1ca29f52e6 req-0a831333-21cb-418b-b3d3-c55f3daaf07b service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:51.611962 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-c06ba3af-c33c-4408-b049-7d1ca29f52e6 req-0a831333-21cb-418b-b3d3-c55f3daaf07b service nova] Creating event network-changed:11155cdc-4e7d-4c79-b482-df219fb67393 for instance 09fac986-176b-43b6-a4c4-c32b1513a3bf on hv-cinder-85391 Aug 22 05:38:51.612719 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c06ba3af-c33c-4408-b049-7d1ca29f52e6 req-0a831333-21cb-418b-b3d3-c55f3daaf07b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132498) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 22 05:38:51.613324 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c06ba3af-c33c-4408-b049-7d1ca29f52e6 req-0a831333-21cb-418b-b3d3-c55f3daaf07b service nova] Acquired lock "compute-rpcapi-router" {{(pid=132498) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 22 05:38:51.614609 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-86253821-4bcc-4079-8b98-4016b2e430eb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:51.615146 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-86253821-4bcc-4079-8b98-4016b2e430eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:51.615711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-86253821-4bcc-4079-8b98-4016b2e430eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:51.616496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-86253821-4bcc-4079-8b98-4016b2e430eb None None] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:51.617100 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-86253821-4bcc-4079-8b98-4016b2e430eb None None] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:51.617633 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-86253821-4bcc-4079-8b98-4016b2e430eb None None] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:51.630653 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.compute.rpcapi [None req-86253821-4bcc-4079-8b98-4016b2e430eb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 22 05:38:51.632526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-86253821-4bcc-4079-8b98-4016b2e430eb None None] Releasing lock "compute-rpcapi-router" {{(pid=132498) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 22 05:38:51.665902 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-86253821-4bcc-4079-8b98-4016b2e430eb None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.326549 Aug 22 05:38:51.667225 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 55/116] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:51.675176 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-1fe37748-d59d-4e5d-ab06-ff3a6c34c51f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:51.685047 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-1fe37748-d59d-4e5d-ab06-ff3a6c34c51f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.264137 Aug 22 05:38:51.686823 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 62/117] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:51 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:52.358551 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9f951e56-4b7c-49da-9bd4-854e41da1f72 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:52.359360 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9f951e56-4b7c-49da-9bd4-854e41da1f72 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:52.369607 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9f951e56-4b7c-49da-9bd4-854e41da1f72 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:52.370251 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9f951e56-4b7c-49da-9bd4-854e41da1f72 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:52.370732 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9f951e56-4b7c-49da-9bd4-854e41da1f72 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:52.371527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9f951e56-4b7c-49da-9bd4-854e41da1f72 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:52.372035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9f951e56-4b7c-49da-9bd4-854e41da1f72 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:52.372661 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9f951e56-4b7c-49da-9bd4-854e41da1f72 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:52.438763 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-60bfa820-a2cc-4e5c-bb85-49b7868264f4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:52.439370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-60bfa820-a2cc-4e5c-bb85-49b7868264f4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:52.445699 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-60bfa820-a2cc-4e5c-bb85-49b7868264f4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:52.446406 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-60bfa820-a2cc-4e5c-bb85-49b7868264f4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:52.446993 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-60bfa820-a2cc-4e5c-bb85-49b7868264f4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:52.447877 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-60bfa820-a2cc-4e5c-bb85-49b7868264f4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:52.448766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-60bfa820-a2cc-4e5c-bb85-49b7868264f4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:52.449323 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-60bfa820-a2cc-4e5c-bb85-49b7868264f4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:52.478040 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=100 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:52.750984 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9f951e56-4b7c-49da-9bd4-854e41da1f72 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:52.754349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:38:52.760903 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9f951e56-4b7c-49da-9bd4-854e41da1f72 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.406645 Aug 22 05:38:52.761490 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 56/118] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:52 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:52.767299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8d8e87e4-8bcb-4b5a-a360-8981d81838bb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:52.768100 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8d8e87e4-8bcb-4b5a-a360-8981d81838bb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:52.775617 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8d8e87e4-8bcb-4b5a-a360-8981d81838bb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:52.776160 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8d8e87e4-8bcb-4b5a-a360-8981d81838bb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:52.776604 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8d8e87e4-8bcb-4b5a-a360-8981d81838bb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:52.777445 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8d8e87e4-8bcb-4b5a-a360-8981d81838bb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:52.777896 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8d8e87e4-8bcb-4b5a-a360-8981d81838bb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:52.778317 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8d8e87e4-8bcb-4b5a-a360-8981d81838bb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:52.872377 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-60bfa820-a2cc-4e5c-bb85-49b7868264f4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:52.894066 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-60bfa820-a2cc-4e5c-bb85-49b7868264f4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.459450 Aug 22 05:38:52.895189 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 63/119] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:52 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:38:52.964919 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8d8e87e4-8bcb-4b5a-a360-8981d81838bb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:52.975117 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8d8e87e4-8bcb-4b5a-a360-8981d81838bb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.212410 Aug 22 05:38:52.975641 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 57/120] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:52 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:53.688141 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-f736002a-bf87-4356-bf2c-b375ca8ddb79 req-9f050ecd-1ea1-450a-9d04-5dd3b93ae0db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "585fdc4d-a711-4748-9480-bb5a9bab88f4", "tag": "1b1f5f40-5b3a-4135-85ac-8b7ecf8f98f5"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:38:53.697650 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-f736002a-bf87-4356-bf2c-b375ca8ddb79 req-9f050ecd-1ea1-450a-9d04-5dd3b93ae0db service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:53.698155 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-f736002a-bf87-4356-bf2c-b375ca8ddb79 req-9f050ecd-1ea1-450a-9d04-5dd3b93ae0db service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:53.698575 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-f736002a-bf87-4356-bf2c-b375ca8ddb79 req-9f050ecd-1ea1-450a-9d04-5dd3b93ae0db service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:53.709852 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-f736002a-bf87-4356-bf2c-b375ca8ddb79 req-9f050ecd-1ea1-450a-9d04-5dd3b93ae0db service nova] Creating event network-changed:1b1f5f40-5b3a-4135-85ac-8b7ecf8f98f5 for instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 on hv-cinder-85391 Aug 22 05:38:53.715270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-f736002a-bf87-4356-bf2c-b375ca8ddb79 req-9f050ecd-1ea1-450a-9d04-5dd3b93ae0db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031034 Aug 22 05:38:53.715915 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 64/121] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:38:53.782631 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-db1f41ae-6db4-4923-a20d-f8673f789e42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:53.783302 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-db1f41ae-6db4-4923-a20d-f8673f789e42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:53.789497 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-db1f41ae-6db4-4923-a20d-f8673f789e42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:53.790112 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-db1f41ae-6db4-4923-a20d-f8673f789e42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:53.790628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-db1f41ae-6db4-4923-a20d-f8673f789e42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:53.791408 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-db1f41ae-6db4-4923-a20d-f8673f789e42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:53.791937 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-db1f41ae-6db4-4923-a20d-f8673f789e42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:53.792414 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-db1f41ae-6db4-4923-a20d-f8673f789e42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:53.916157 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-2e1da784-3bf9-4430-b836-2eecf264a481 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:53.916896 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-2e1da784-3bf9-4430-b836-2eecf264a481 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:53.923139 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2e1da784-3bf9-4430-b836-2eecf264a481 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:53.923663 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2e1da784-3bf9-4430-b836-2eecf264a481 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:53.924093 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2e1da784-3bf9-4430-b836-2eecf264a481 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:53.924774 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2e1da784-3bf9-4430-b836-2eecf264a481 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:53.925217 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2e1da784-3bf9-4430-b836-2eecf264a481 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:53.925630 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2e1da784-3bf9-4430-b836-2eecf264a481 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:54.046254 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-db1f41ae-6db4-4923-a20d-f8673f789e42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:54.067900 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-db1f41ae-6db4-4923-a20d-f8673f789e42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.289651 Aug 22 05:38:54.081477 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 58/122] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:53 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:54.102669 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-69051084-245d-4141-95fb-5f1a5d0f2a2d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:54.103817 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-69051084-245d-4141-95fb-5f1a5d0f2a2d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:54.110078 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-69051084-245d-4141-95fb-5f1a5d0f2a2d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:54.110762 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-69051084-245d-4141-95fb-5f1a5d0f2a2d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:54.111348 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-69051084-245d-4141-95fb-5f1a5d0f2a2d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:54.112403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-69051084-245d-4141-95fb-5f1a5d0f2a2d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:54.113426 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-69051084-245d-4141-95fb-5f1a5d0f2a2d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:54.114147 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-69051084-245d-4141-95fb-5f1a5d0f2a2d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:54.152873 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-2e1da784-3bf9-4430-b836-2eecf264a481 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:54.161145 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-2e1da784-3bf9-4430-b836-2eecf264a481 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.249285 Aug 22 05:38:54.161889 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 65/123] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:53 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:54.267284 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-69051084-245d-4141-95fb-5f1a5d0f2a2d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:54.275356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-69051084-245d-4141-95fb-5f1a5d0f2a2d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.192569 Aug 22 05:38:54.275960 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 59/124] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:54 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:55.108262 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-d57b5a28-ba80-43a9-952a-f69ee0bfb531 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:55.109010 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-d57b5a28-ba80-43a9-952a-f69ee0bfb531 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:55.115157 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d57b5a28-ba80-43a9-952a-f69ee0bfb531 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:55.115691 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d57b5a28-ba80-43a9-952a-f69ee0bfb531 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:55.116129 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d57b5a28-ba80-43a9-952a-f69ee0bfb531 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:55.116806 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d57b5a28-ba80-43a9-952a-f69ee0bfb531 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:55.117251 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d57b5a28-ba80-43a9-952a-f69ee0bfb531 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:55.117643 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d57b5a28-ba80-43a9-952a-f69ee0bfb531 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:55.181906 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d4168741-7dbe-4907-b45d-8e9b285ea730 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:55.182508 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d4168741-7dbe-4907-b45d-8e9b285ea730 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:55.189113 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4168741-7dbe-4907-b45d-8e9b285ea730 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:55.189599 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4168741-7dbe-4907-b45d-8e9b285ea730 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:55.190024 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4168741-7dbe-4907-b45d-8e9b285ea730 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:55.190713 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4168741-7dbe-4907-b45d-8e9b285ea730 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:55.191151 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4168741-7dbe-4907-b45d-8e9b285ea730 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:55.191561 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4168741-7dbe-4907-b45d-8e9b285ea730 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:55.333210 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-d57b5a28-ba80-43a9-952a-f69ee0bfb531 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:55.342057 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-d57b5a28-ba80-43a9-952a-f69ee0bfb531 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.237317 Aug 22 05:38:55.342862 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 66/125] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:55 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:55.348354 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-198cccb8-97f9-4830-8aea-6ed347bdc3cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:55.349256 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-198cccb8-97f9-4830-8aea-6ed347bdc3cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:55.355738 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-198cccb8-97f9-4830-8aea-6ed347bdc3cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:55.356664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-198cccb8-97f9-4830-8aea-6ed347bdc3cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:55.357184 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-198cccb8-97f9-4830-8aea-6ed347bdc3cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:55.357957 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-198cccb8-97f9-4830-8aea-6ed347bdc3cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:55.358400 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-198cccb8-97f9-4830-8aea-6ed347bdc3cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:55.358862 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-198cccb8-97f9-4830-8aea-6ed347bdc3cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:55.377463 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d4168741-7dbe-4907-b45d-8e9b285ea730 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:55.386332 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d4168741-7dbe-4907-b45d-8e9b285ea730 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.208006 Aug 22 05:38:55.387121 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 60/126] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:55 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:38:55.495706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-198cccb8-97f9-4830-8aea-6ed347bdc3cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:55.503753 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-198cccb8-97f9-4830-8aea-6ed347bdc3cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.158898 Aug 22 05:38:55.504323 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 67/127] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:55 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:56.363280 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-55dbda9f-10e3-401e-8b3f-38493331075c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:56.363916 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-55dbda9f-10e3-401e-8b3f-38493331075c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:56.373887 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-55dbda9f-10e3-401e-8b3f-38493331075c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:56.374706 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-55dbda9f-10e3-401e-8b3f-38493331075c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:56.375267 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-55dbda9f-10e3-401e-8b3f-38493331075c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:56.376112 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-55dbda9f-10e3-401e-8b3f-38493331075c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:56.376684 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-55dbda9f-10e3-401e-8b3f-38493331075c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:56.377173 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-55dbda9f-10e3-401e-8b3f-38493331075c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:56.406283 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-160931c0-0713-4495-b3c0-0a15f9f35394 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:56.407001 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-160931c0-0713-4495-b3c0-0a15f9f35394 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:56.425520 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-160931c0-0713-4495-b3c0-0a15f9f35394 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:56.425978 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-160931c0-0713-4495-b3c0-0a15f9f35394 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:56.426403 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-160931c0-0713-4495-b3c0-0a15f9f35394 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:56.427126 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-160931c0-0713-4495-b3c0-0a15f9f35394 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:56.427561 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-160931c0-0713-4495-b3c0-0a15f9f35394 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:56.427982 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-160931c0-0713-4495-b3c0-0a15f9f35394 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:56.584391 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-55dbda9f-10e3-401e-8b3f-38493331075c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:56.592382 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-55dbda9f-10e3-401e-8b3f-38493331075c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.233808 Aug 22 05:38:56.607057 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 61/128] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:56 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:56.607057 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e18f212d-6c0b-44ea-a75f-de74f5a68c10 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:56.607057 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e18f212d-6c0b-44ea-a75f-de74f5a68c10 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:56.607057 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e18f212d-6c0b-44ea-a75f-de74f5a68c10 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:56.607057 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e18f212d-6c0b-44ea-a75f-de74f5a68c10 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:56.607513 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e18f212d-6c0b-44ea-a75f-de74f5a68c10 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:56.607513 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e18f212d-6c0b-44ea-a75f-de74f5a68c10 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:56.607513 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e18f212d-6c0b-44ea-a75f-de74f5a68c10 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:56.608225 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e18f212d-6c0b-44ea-a75f-de74f5a68c10 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:56.629754 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-160931c0-0713-4495-b3c0-0a15f9f35394 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:56.638395 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-160931c0-0713-4495-b3c0-0a15f9f35394 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.236119 Aug 22 05:38:56.639000 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 68/129] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:56 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:56.756045 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e18f212d-6c0b-44ea-a75f-de74f5a68c10 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:56.763938 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e18f212d-6c0b-44ea-a75f-de74f5a68c10 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.169330 Aug 22 05:38:56.764486 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 62/130] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:56 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:57.614719 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-3b1f0704-06c3-4ffd-b73f-a193f241ba32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:57.615319 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-3b1f0704-06c3-4ffd-b73f-a193f241ba32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:57.621364 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3b1f0704-06c3-4ffd-b73f-a193f241ba32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:57.621858 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3b1f0704-06c3-4ffd-b73f-a193f241ba32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:57.622264 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3b1f0704-06c3-4ffd-b73f-a193f241ba32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:57.622958 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3b1f0704-06c3-4ffd-b73f-a193f241ba32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:57.623398 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3b1f0704-06c3-4ffd-b73f-a193f241ba32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:57.623832 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3b1f0704-06c3-4ffd-b73f-a193f241ba32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:57.659594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6bc1dff0-f6e4-42fa-bba1-fcd263f45998 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:57.660601 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6bc1dff0-f6e4-42fa-bba1-fcd263f45998 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:57.667492 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6bc1dff0-f6e4-42fa-bba1-fcd263f45998 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:57.668162 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6bc1dff0-f6e4-42fa-bba1-fcd263f45998 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:57.668604 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6bc1dff0-f6e4-42fa-bba1-fcd263f45998 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:57.669300 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6bc1dff0-f6e4-42fa-bba1-fcd263f45998 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:57.669747 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6bc1dff0-f6e4-42fa-bba1-fcd263f45998 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:57.670157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6bc1dff0-f6e4-42fa-bba1-fcd263f45998 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:57.812951 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-3b1f0704-06c3-4ffd-b73f-a193f241ba32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:57.821549 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-3b1f0704-06c3-4ffd-b73f-a193f241ba32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.210593 Aug 22 05:38:57.822417 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 69/131] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:57 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:57.827307 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a656ddd6-44af-438d-9d0b-dc5bcb2b4283 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:57.839312 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a656ddd6-44af-438d-9d0b-dc5bcb2b4283 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:57.848575 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6bc1dff0-f6e4-42fa-bba1-fcd263f45998 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:57.851155 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a656ddd6-44af-438d-9d0b-dc5bcb2b4283 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:57.851851 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a656ddd6-44af-438d-9d0b-dc5bcb2b4283 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:57.852415 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a656ddd6-44af-438d-9d0b-dc5bcb2b4283 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:57.853249 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a656ddd6-44af-438d-9d0b-dc5bcb2b4283 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:57.853960 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a656ddd6-44af-438d-9d0b-dc5bcb2b4283 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:57.854682 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a656ddd6-44af-438d-9d0b-dc5bcb2b4283 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:57.859702 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6bc1dff0-f6e4-42fa-bba1-fcd263f45998 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.203322 Aug 22 05:38:57.873305 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 63/132] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:57 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:38:58.067844 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a656ddd6-44af-438d-9d0b-dc5bcb2b4283 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:58.076273 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a656ddd6-44af-438d-9d0b-dc5bcb2b4283 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.252706 Aug 22 05:38:58.076991 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 70/133] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:57 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:58.842600 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-14ea722e-0fe1-47ea-a547-a107af5796aa tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:58.843631 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-14ea722e-0fe1-47ea-a547-a107af5796aa tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:58.850223 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-14ea722e-0fe1-47ea-a547-a107af5796aa tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:58.850689 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-14ea722e-0fe1-47ea-a547-a107af5796aa tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:58.851112 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-14ea722e-0fe1-47ea-a547-a107af5796aa tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:58.851855 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-14ea722e-0fe1-47ea-a547-a107af5796aa tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:58.852297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-14ea722e-0fe1-47ea-a547-a107af5796aa tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:58.852776 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-14ea722e-0fe1-47ea-a547-a107af5796aa tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:58.880860 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4c45cee2-fc57-443d-9604-0faba82052cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:58.881524 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4c45cee2-fc57-443d-9604-0faba82052cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:58.888718 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c45cee2-fc57-443d-9604-0faba82052cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:58.889240 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c45cee2-fc57-443d-9604-0faba82052cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:58.889679 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c45cee2-fc57-443d-9604-0faba82052cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:58.890376 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c45cee2-fc57-443d-9604-0faba82052cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:58.890897 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c45cee2-fc57-443d-9604-0faba82052cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:58.891354 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c45cee2-fc57-443d-9604-0faba82052cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:59.054842 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-14ea722e-0fe1-47ea-a547-a107af5796aa tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:59.064707 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-14ea722e-0fe1-47ea-a547-a107af5796aa tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.226089 Aug 22 05:38:59.065393 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 64/134] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:58 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:59.078921 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4c45cee2-fc57-443d-9604-0faba82052cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:59.086609 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4c45cee2-fc57-443d-9604-0faba82052cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.209638 Aug 22 05:38:59.087168 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 71/135] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:58 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:38:59.098115 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-00af34ef-8fb3-4b1c-a2df-ba6ffd62972c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:38:59.098886 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-00af34ef-8fb3-4b1c-a2df-ba6ffd62972c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:38:59.104982 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00af34ef-8fb3-4b1c-a2df-ba6ffd62972c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:59.105460 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00af34ef-8fb3-4b1c-a2df-ba6ffd62972c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:59.105871 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00af34ef-8fb3-4b1c-a2df-ba6ffd62972c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:59.106545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00af34ef-8fb3-4b1c-a2df-ba6ffd62972c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:38:59.106983 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00af34ef-8fb3-4b1c-a2df-ba6ffd62972c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:38:59.107429 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00af34ef-8fb3-4b1c-a2df-ba6ffd62972c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:38:59.238343 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-00af34ef-8fb3-4b1c-a2df-ba6ffd62972c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:38:59.246642 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-00af34ef-8fb3-4b1c-a2df-ba6ffd62972c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.152863 Aug 22 05:38:59.247219 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 65/136] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:38:59 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:39:00.085572 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f172896d-5160-4fae-8d54-26c2b364442c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:00.086081 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f172896d-5160-4fae-8d54-26c2b364442c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:00.094272 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f172896d-5160-4fae-8d54-26c2b364442c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:00.094956 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f172896d-5160-4fae-8d54-26c2b364442c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:00.095367 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f172896d-5160-4fae-8d54-26c2b364442c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:00.096332 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f172896d-5160-4fae-8d54-26c2b364442c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:00.096999 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f172896d-5160-4fae-8d54-26c2b364442c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:00.097546 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f172896d-5160-4fae-8d54-26c2b364442c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:00.108237 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3bd11b3e-0891-4c36-a2cd-1cf0e22d2542 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:00.109060 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3bd11b3e-0891-4c36-a2cd-1cf0e22d2542 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:00.115152 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3bd11b3e-0891-4c36-a2cd-1cf0e22d2542 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:00.115666 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3bd11b3e-0891-4c36-a2cd-1cf0e22d2542 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:00.116088 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3bd11b3e-0891-4c36-a2cd-1cf0e22d2542 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:00.116774 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3bd11b3e-0891-4c36-a2cd-1cf0e22d2542 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:00.117214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3bd11b3e-0891-4c36-a2cd-1cf0e22d2542 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:00.117612 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3bd11b3e-0891-4c36-a2cd-1cf0e22d2542 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:00.295519 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-f172896d-5160-4fae-8d54-26c2b364442c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:00.299006 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3bd11b3e-0891-4c36-a2cd-1cf0e22d2542 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:00.303486 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f172896d-5160-4fae-8d54-26c2b364442c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.221799 Aug 22 05:39:00.304187 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 72/137] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:00 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:00.306799 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3bd11b3e-0891-4c36-a2cd-1cf0e22d2542 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.202669 Aug 22 05:39:00.311985 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 66/138] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:00 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:00.312154 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-94a6b272-6ee5-406c-9669-8ae8d587b2cb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:00.312154 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-94a6b272-6ee5-406c-9669-8ae8d587b2cb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:00.315559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-94a6b272-6ee5-406c-9669-8ae8d587b2cb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:00.316121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-94a6b272-6ee5-406c-9669-8ae8d587b2cb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:00.316613 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-94a6b272-6ee5-406c-9669-8ae8d587b2cb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:00.317370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-94a6b272-6ee5-406c-9669-8ae8d587b2cb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:00.317820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-94a6b272-6ee5-406c-9669-8ae8d587b2cb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:00.318213 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-94a6b272-6ee5-406c-9669-8ae8d587b2cb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:00.466311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-94a6b272-6ee5-406c-9669-8ae8d587b2cb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:00.475180 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-94a6b272-6ee5-406c-9669-8ae8d587b2cb tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.169912 Aug 22 05:39:00.475786 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 73/139] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:00 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:01.329649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8edb4ea5-8d4a-4f41-b41f-237c1884d6ab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:01.330643 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8edb4ea5-8d4a-4f41-b41f-237c1884d6ab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:01.332461 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-44d949db-275c-46f4-93a1-f191d6ac63a6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:01.333482 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-44d949db-275c-46f4-93a1-f191d6ac63a6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:01.340947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8edb4ea5-8d4a-4f41-b41f-237c1884d6ab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:01.341786 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8edb4ea5-8d4a-4f41-b41f-237c1884d6ab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:01.342499 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8edb4ea5-8d4a-4f41-b41f-237c1884d6ab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:01.343719 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44d949db-275c-46f4-93a1-f191d6ac63a6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:01.343911 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8edb4ea5-8d4a-4f41-b41f-237c1884d6ab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:01.344220 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44d949db-275c-46f4-93a1-f191d6ac63a6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:01.344373 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8edb4ea5-8d4a-4f41-b41f-237c1884d6ab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:01.344701 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44d949db-275c-46f4-93a1-f191d6ac63a6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:01.344838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8edb4ea5-8d4a-4f41-b41f-237c1884d6ab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:01.345383 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44d949db-275c-46f4-93a1-f191d6ac63a6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:01.345823 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44d949db-275c-46f4-93a1-f191d6ac63a6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:01.346234 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44d949db-275c-46f4-93a1-f191d6ac63a6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:01.537713 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8edb4ea5-8d4a-4f41-b41f-237c1884d6ab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:01.541108 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-44d949db-275c-46f4-93a1-f191d6ac63a6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:01.546337 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8edb4ea5-8d4a-4f41-b41f-237c1884d6ab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.224257 Aug 22 05:39:01.547360 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 67/140] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:01 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:01.549699 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-44d949db-275c-46f4-93a1-f191d6ac63a6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.224500 Aug 22 05:39:01.552691 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-06961cf3-d4c4-4176-9b49-54e4e8015d4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:01.553570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-06961cf3-d4c4-4176-9b49-54e4e8015d4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:01.560174 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-06961cf3-d4c4-4176-9b49-54e4e8015d4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:01.560856 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-06961cf3-d4c4-4176-9b49-54e4e8015d4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:01.561545 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 74/141] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:01 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:39:01.561777 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-06961cf3-d4c4-4176-9b49-54e4e8015d4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:01.562650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-06961cf3-d4c4-4176-9b49-54e4e8015d4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:01.563309 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-06961cf3-d4c4-4176-9b49-54e4e8015d4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:01.563861 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-06961cf3-d4c4-4176-9b49-54e4e8015d4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:01.629698 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:39:01.701005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-06961cf3-d4c4-4176-9b49-54e4e8015d4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:01.709569 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-06961cf3-d4c4-4176-9b49-54e4e8015d4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.161034 Aug 22 05:39:01.710159 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 68/142] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:01 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:02.569689 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-425eb5d3-a072-4972-a98c-41de7afc3ea5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:02.570216 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-95eb7391-6cec-498d-a630-88bfbfeab7dc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:02.570676 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-425eb5d3-a072-4972-a98c-41de7afc3ea5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:02.571471 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-95eb7391-6cec-498d-a630-88bfbfeab7dc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:02.578082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-95eb7391-6cec-498d-a630-88bfbfeab7dc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:02.578282 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-425eb5d3-a072-4972-a98c-41de7afc3ea5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:02.578734 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-425eb5d3-a072-4972-a98c-41de7afc3ea5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:02.579162 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-95eb7391-6cec-498d-a630-88bfbfeab7dc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:02.579277 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-425eb5d3-a072-4972-a98c-41de7afc3ea5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:02.579923 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-95eb7391-6cec-498d-a630-88bfbfeab7dc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:02.580044 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-425eb5d3-a072-4972-a98c-41de7afc3ea5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:02.580544 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-425eb5d3-a072-4972-a98c-41de7afc3ea5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:02.581019 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-425eb5d3-a072-4972-a98c-41de7afc3ea5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:02.581368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-95eb7391-6cec-498d-a630-88bfbfeab7dc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:02.581986 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-95eb7391-6cec-498d-a630-88bfbfeab7dc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:02.582575 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-95eb7391-6cec-498d-a630-88bfbfeab7dc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:03.057375 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-425eb5d3-a072-4972-a98c-41de7afc3ea5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:03.060644 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-95eb7391-6cec-498d-a630-88bfbfeab7dc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:03.065401 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-425eb5d3-a072-4972-a98c-41de7afc3ea5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.500203 Aug 22 05:39:03.065982 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 75/143] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:02 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:03.068644 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-95eb7391-6cec-498d-a630-88bfbfeab7dc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.502197 Aug 22 05:39:03.069384 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 69/144] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:02 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:03.070724 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-be19f966-636e-435d-9ec0-9e60eac90906 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:03.071355 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-be19f966-636e-435d-9ec0-9e60eac90906 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:03.077151 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-be19f966-636e-435d-9ec0-9e60eac90906 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:03.077630 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-be19f966-636e-435d-9ec0-9e60eac90906 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:03.078056 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-be19f966-636e-435d-9ec0-9e60eac90906 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:03.078838 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-be19f966-636e-435d-9ec0-9e60eac90906 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:03.079294 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-be19f966-636e-435d-9ec0-9e60eac90906 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:03.079738 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-be19f966-636e-435d-9ec0-9e60eac90906 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:03.237345 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-be19f966-636e-435d-9ec0-9e60eac90906 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:03.248198 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-be19f966-636e-435d-9ec0-9e60eac90906 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.180943 Aug 22 05:39:03.249038 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 76/145] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:03 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:04.088244 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3b56fad9-7c05-4b7a-b262-e3e76a6acb63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:04.088926 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3b56fad9-7c05-4b7a-b262-e3e76a6acb63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:04.089281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-cbea25cb-a228-45cb-a81f-401dfa80b6ac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:04.089888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-cbea25cb-a228-45cb-a81f-401dfa80b6ac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:04.096805 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b56fad9-7c05-4b7a-b262-e3e76a6acb63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:04.097454 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b56fad9-7c05-4b7a-b262-e3e76a6acb63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:04.097897 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b56fad9-7c05-4b7a-b262-e3e76a6acb63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:04.098721 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cbea25cb-a228-45cb-a81f-401dfa80b6ac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:04.098851 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b56fad9-7c05-4b7a-b262-e3e76a6acb63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:04.099222 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b56fad9-7c05-4b7a-b262-e3e76a6acb63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:04.099339 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cbea25cb-a228-45cb-a81f-401dfa80b6ac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:04.099608 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b56fad9-7c05-4b7a-b262-e3e76a6acb63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:04.099729 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cbea25cb-a228-45cb-a81f-401dfa80b6ac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:04.100416 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cbea25cb-a228-45cb-a81f-401dfa80b6ac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:04.101268 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cbea25cb-a228-45cb-a81f-401dfa80b6ac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:04.101692 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cbea25cb-a228-45cb-a81f-401dfa80b6ac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:04.359909 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-cbea25cb-a228-45cb-a81f-401dfa80b6ac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:04.368453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-cbea25cb-a228-45cb-a81f-401dfa80b6ac tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.283169 Aug 22 05:39:04.369171 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 77/146] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:04 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:39:04.375021 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f19e853a-4b29-417a-a4d9-96a3d33acd67 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:04.375926 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f19e853a-4b29-417a-a4d9-96a3d33acd67 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:04.384267 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f19e853a-4b29-417a-a4d9-96a3d33acd67 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:04.385127 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f19e853a-4b29-417a-a4d9-96a3d33acd67 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:04.385551 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f19e853a-4b29-417a-a4d9-96a3d33acd67 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:04.386271 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f19e853a-4b29-417a-a4d9-96a3d33acd67 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:04.387032 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f19e853a-4b29-417a-a4d9-96a3d33acd67 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:04.387477 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f19e853a-4b29-417a-a4d9-96a3d33acd67 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:04.389502 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3b56fad9-7c05-4b7a-b262-e3e76a6acb63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:04.397402 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3b56fad9-7c05-4b7a-b262-e3e76a6acb63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.314204 Aug 22 05:39:04.397983 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 70/147] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:04 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:39:04.517449 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-f19e853a-4b29-417a-a4d9-96a3d33acd67 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:04.525184 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f19e853a-4b29-417a-a4d9-96a3d33acd67 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.154834 Aug 22 05:39:04.525769 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 78/148] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:04 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:05.390524 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ab9d0a0b-9133-4e2a-b63b-067dfc9aba6c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:05.392313 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ab9d0a0b-9133-4e2a-b63b-067dfc9aba6c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:05.398682 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab9d0a0b-9133-4e2a-b63b-067dfc9aba6c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:05.399171 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab9d0a0b-9133-4e2a-b63b-067dfc9aba6c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:05.399605 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab9d0a0b-9133-4e2a-b63b-067dfc9aba6c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:05.400510 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab9d0a0b-9133-4e2a-b63b-067dfc9aba6c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:05.400954 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab9d0a0b-9133-4e2a-b63b-067dfc9aba6c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:05.401484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab9d0a0b-9133-4e2a-b63b-067dfc9aba6c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:05.418473 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8d2a3eff-9706-418b-a0bc-52a60b14a77f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:05.419093 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8d2a3eff-9706-418b-a0bc-52a60b14a77f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:05.431873 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8d2a3eff-9706-418b-a0bc-52a60b14a77f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:05.432623 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8d2a3eff-9706-418b-a0bc-52a60b14a77f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:05.433345 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8d2a3eff-9706-418b-a0bc-52a60b14a77f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:05.434276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8d2a3eff-9706-418b-a0bc-52a60b14a77f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:05.434906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8d2a3eff-9706-418b-a0bc-52a60b14a77f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:05.435511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8d2a3eff-9706-418b-a0bc-52a60b14a77f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:05.648211 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8d2a3eff-9706-418b-a0bc-52a60b14a77f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:05.651154 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ab9d0a0b-9133-4e2a-b63b-067dfc9aba6c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:05.656425 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8d2a3eff-9706-418b-a0bc-52a60b14a77f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.242121 Aug 22 05:39:05.656996 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 79/149] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:05 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:05.659187 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ab9d0a0b-9133-4e2a-b63b-067dfc9aba6c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.272825 Aug 22 05:39:05.672119 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 71/150] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:05 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:05.672477 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-87914a8f-f44b-4392-afd4-97e784a52a33 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:05.672477 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-87914a8f-f44b-4392-afd4-97e784a52a33 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:05.672477 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-87914a8f-f44b-4392-afd4-97e784a52a33 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:05.672477 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-87914a8f-f44b-4392-afd4-97e784a52a33 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:05.672733 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-87914a8f-f44b-4392-afd4-97e784a52a33 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:05.672733 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-87914a8f-f44b-4392-afd4-97e784a52a33 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:05.672733 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-87914a8f-f44b-4392-afd4-97e784a52a33 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:05.672733 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-87914a8f-f44b-4392-afd4-97e784a52a33 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:05.722931 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-a2fa66ec-6443-45b8-9bcf-cc48bd855867 req-fc5f96b3-fa34-4e49-9987-88b5c1ef32c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ee8e71-810f-4f41-af8a-9bed26135368", "name": "network-vif-plugged", "status": "completed", "tag": "977bea28-5f40-42b4-ad5a-b1856e7e992b"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:39:05.732663 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-a2fa66ec-6443-45b8-9bcf-cc48bd855867 req-fc5f96b3-fa34-4e49-9987-88b5c1ef32c3 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:05.733506 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-a2fa66ec-6443-45b8-9bcf-cc48bd855867 req-fc5f96b3-fa34-4e49-9987-88b5c1ef32c3 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:05.733653 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-a2fa66ec-6443-45b8-9bcf-cc48bd855867 req-fc5f96b3-fa34-4e49-9987-88b5c1ef32c3 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:05.744855 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-a2fa66ec-6443-45b8-9bcf-cc48bd855867 req-fc5f96b3-fa34-4e49-9987-88b5c1ef32c3 service nova] Creating event network-vif-plugged:977bea28-5f40-42b4-ad5a-b1856e7e992b for instance f8ee8e71-810f-4f41-af8a-9bed26135368 on hv-cinder-85391 Aug 22 05:39:05.749969 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-a2fa66ec-6443-45b8-9bcf-cc48bd855867 req-fc5f96b3-fa34-4e49-9987-88b5c1ef32c3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088669 Aug 22 05:39:05.750556 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 72/151] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:39:05.799047 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-87914a8f-f44b-4392-afd4-97e784a52a33 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:05.802662 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=100 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:39:05.807887 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-87914a8f-f44b-4392-afd4-97e784a52a33 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.149782 Aug 22 05:39:05.808455 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 80/152] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:05 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:06.683407 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2c419959-c2ee-4820-9535-20cc36d9a15b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:06.684294 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-fa0534ca-a90b-4a44-8418-a67726262dbf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:06.684294 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-fa0534ca-a90b-4a44-8418-a67726262dbf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:06.685007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2c419959-c2ee-4820-9535-20cc36d9a15b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:06.695154 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fa0534ca-a90b-4a44-8418-a67726262dbf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:06.695889 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2c419959-c2ee-4820-9535-20cc36d9a15b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:06.696114 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fa0534ca-a90b-4a44-8418-a67726262dbf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:06.696680 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2c419959-c2ee-4820-9535-20cc36d9a15b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:06.696917 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fa0534ca-a90b-4a44-8418-a67726262dbf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:06.697404 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2c419959-c2ee-4820-9535-20cc36d9a15b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:06.697810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fa0534ca-a90b-4a44-8418-a67726262dbf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:06.698537 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2c419959-c2ee-4820-9535-20cc36d9a15b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:06.698759 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fa0534ca-a90b-4a44-8418-a67726262dbf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:06.699254 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fa0534ca-a90b-4a44-8418-a67726262dbf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:06.699500 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2c419959-c2ee-4820-9535-20cc36d9a15b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:06.700003 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2c419959-c2ee-4820-9535-20cc36d9a15b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:06.899984 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-fa0534ca-a90b-4a44-8418-a67726262dbf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:06.906463 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2c419959-c2ee-4820-9535-20cc36d9a15b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:06.908261 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-fa0534ca-a90b-4a44-8418-a67726262dbf tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.231900 Aug 22 05:39:06.908945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 81/153] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:06 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:06.913423 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-9e16e3e4-da46-4206-ba5b-21355c2194e8 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:06.914420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-9e16e3e4-da46-4206-ba5b-21355c2194e8 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:06.915100 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2c419959-c2ee-4820-9535-20cc36d9a15b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.239049 Aug 22 05:39:06.918518 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 73/154] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:06 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:06.925157 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9e16e3e4-da46-4206-ba5b-21355c2194e8 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:06.925644 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9e16e3e4-da46-4206-ba5b-21355c2194e8 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:06.926046 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9e16e3e4-da46-4206-ba5b-21355c2194e8 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:06.927000 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9e16e3e4-da46-4206-ba5b-21355c2194e8 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:06.927844 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9e16e3e4-da46-4206-ba5b-21355c2194e8 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:06.928567 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9e16e3e4-da46-4206-ba5b-21355c2194e8 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:07.070033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-9e16e3e4-da46-4206-ba5b-21355c2194e8 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:07.077713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-9e16e3e4-da46-4206-ba5b-21355c2194e8 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.167787 Aug 22 05:39:07.078271 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 82/155] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:06 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:07.929930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8aeba37c-e046-42e1-9536-60ea7b562649 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:07.930632 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8aeba37c-e046-42e1-9536-60ea7b562649 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:07.935407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-07de2200-7e08-4b0d-b668-800d4b4afc4b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:07.936032 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-07de2200-7e08-4b0d-b668-800d4b4afc4b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:07.937072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8aeba37c-e046-42e1-9536-60ea7b562649 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:07.937520 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8aeba37c-e046-42e1-9536-60ea7b562649 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:07.938007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8aeba37c-e046-42e1-9536-60ea7b562649 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:07.938911 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8aeba37c-e046-42e1-9536-60ea7b562649 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:07.939466 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8aeba37c-e046-42e1-9536-60ea7b562649 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:07.939908 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8aeba37c-e046-42e1-9536-60ea7b562649 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:07.942867 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-07de2200-7e08-4b0d-b668-800d4b4afc4b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:07.943341 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-07de2200-7e08-4b0d-b668-800d4b4afc4b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:07.943843 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-07de2200-7e08-4b0d-b668-800d4b4afc4b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:07.944060 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:39:07.944530 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-07de2200-7e08-4b0d-b668-800d4b4afc4b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:07.944938 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-07de2200-7e08-4b0d-b668-800d4b4afc4b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:07.945350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-07de2200-7e08-4b0d-b668-800d4b4afc4b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:08.145377 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8aeba37c-e046-42e1-9536-60ea7b562649 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:08.148590 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-07de2200-7e08-4b0d-b668-800d4b4afc4b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:08.153473 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8aeba37c-e046-42e1-9536-60ea7b562649 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.227507 Aug 22 05:39:08.154109 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 74/156] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:07 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:08.157734 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-07de2200-7e08-4b0d-b668-800d4b4afc4b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.226140 Aug 22 05:39:08.158340 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 83/157] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:07 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:08.159583 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9380cad5-2bbb-419b-82cc-c129aff7a8f1 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:08.160265 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9380cad5-2bbb-419b-82cc-c129aff7a8f1 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:08.166197 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9380cad5-2bbb-419b-82cc-c129aff7a8f1 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:08.166744 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9380cad5-2bbb-419b-82cc-c129aff7a8f1 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:08.167191 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9380cad5-2bbb-419b-82cc-c129aff7a8f1 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:08.167894 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9380cad5-2bbb-419b-82cc-c129aff7a8f1 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:08.168343 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9380cad5-2bbb-419b-82cc-c129aff7a8f1 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:08.168757 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9380cad5-2bbb-419b-82cc-c129aff7a8f1 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:08.307655 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9380cad5-2bbb-419b-82cc-c129aff7a8f1 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:08.315921 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9380cad5-2bbb-419b-82cc-c129aff7a8f1 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.160475 Aug 22 05:39:08.316508 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 75/158] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:08 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:09.175013 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0700ffa8-c8c4-4f2a-92c1-2373cf7fe3cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:09.175819 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0700ffa8-c8c4-4f2a-92c1-2373cf7fe3cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:09.177758 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=76 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:39:09.183916 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0700ffa8-c8c4-4f2a-92c1-2373cf7fe3cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:09.184393 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0700ffa8-c8c4-4f2a-92c1-2373cf7fe3cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:09.184818 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0700ffa8-c8c4-4f2a-92c1-2373cf7fe3cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:09.185023 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4bfff6d0-9b1f-4959-a065-46b8edcfd978 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:09.185560 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0700ffa8-c8c4-4f2a-92c1-2373cf7fe3cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:09.185635 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4bfff6d0-9b1f-4959-a065-46b8edcfd978 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:09.185940 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0700ffa8-c8c4-4f2a-92c1-2373cf7fe3cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:09.186464 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0700ffa8-c8c4-4f2a-92c1-2373cf7fe3cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:09.191891 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bfff6d0-9b1f-4959-a065-46b8edcfd978 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:09.192663 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bfff6d0-9b1f-4959-a065-46b8edcfd978 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:09.193451 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bfff6d0-9b1f-4959-a065-46b8edcfd978 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:09.194404 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bfff6d0-9b1f-4959-a065-46b8edcfd978 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:09.194848 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bfff6d0-9b1f-4959-a065-46b8edcfd978 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:09.195411 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bfff6d0-9b1f-4959-a065-46b8edcfd978 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:09.551082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4bfff6d0-9b1f-4959-a065-46b8edcfd978 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:09.563529 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4bfff6d0-9b1f-4959-a065-46b8edcfd978 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.382569 Aug 22 05:39:09.564599 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 76/159] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:09 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:09.571589 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-60a4a9ac-c860-40bb-8d69-2df2f9427421 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:09.573009 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-60a4a9ac-c860-40bb-8d69-2df2f9427421 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:09.579750 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60a4a9ac-c860-40bb-8d69-2df2f9427421 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:09.580549 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60a4a9ac-c860-40bb-8d69-2df2f9427421 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:09.581568 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60a4a9ac-c860-40bb-8d69-2df2f9427421 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:09.582503 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60a4a9ac-c860-40bb-8d69-2df2f9427421 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:09.583457 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60a4a9ac-c860-40bb-8d69-2df2f9427421 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:09.584089 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60a4a9ac-c860-40bb-8d69-2df2f9427421 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:09.627058 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0700ffa8-c8c4-4f2a-92c1-2373cf7fe3cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:09.638606 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0700ffa8-c8c4-4f2a-92c1-2373cf7fe3cd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.466978 Aug 22 05:39:09.639708 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 84/160] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:09 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:09.950481 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-60a4a9ac-c860-40bb-8d69-2df2f9427421 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:09.963144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-60a4a9ac-c860-40bb-8d69-2df2f9427421 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.394603 Aug 22 05:39:09.964324 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 77/161] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:09 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:10.585347 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6a40f1db-748d-4de5-baf5-1c8b444e90f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:10.586472 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-6a40f1db-748d-4de5-baf5-1c8b444e90f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:10.592612 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a40f1db-748d-4de5-baf5-1c8b444e90f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:10.593695 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a40f1db-748d-4de5-baf5-1c8b444e90f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:10.594224 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a40f1db-748d-4de5-baf5-1c8b444e90f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:10.595001 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a40f1db-748d-4de5-baf5-1c8b444e90f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:10.595617 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a40f1db-748d-4de5-baf5-1c8b444e90f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:10.596266 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a40f1db-748d-4de5-baf5-1c8b444e90f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:10.672488 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-42d54c15-9a83-4e67-acd2-4781934e7eb8 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:10.672488 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-42d54c15-9a83-4e67-acd2-4781934e7eb8 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:10.681987 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42d54c15-9a83-4e67-acd2-4781934e7eb8 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:10.682962 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42d54c15-9a83-4e67-acd2-4781934e7eb8 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:10.684020 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42d54c15-9a83-4e67-acd2-4781934e7eb8 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:10.685420 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42d54c15-9a83-4e67-acd2-4781934e7eb8 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:10.686554 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42d54c15-9a83-4e67-acd2-4781934e7eb8 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:10.687596 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42d54c15-9a83-4e67-acd2-4781934e7eb8 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:10.848263 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6a40f1db-748d-4de5-baf5-1c8b444e90f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:10.872093 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6a40f1db-748d-4de5-baf5-1c8b444e90f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.281615 Aug 22 05:39:10.872914 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 85/162] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:10 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:10.937479 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-42d54c15-9a83-4e67-acd2-4781934e7eb8 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:10.946879 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-42d54c15-9a83-4e67-acd2-4781934e7eb8 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.287290 Aug 22 05:39:10.947527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 78/163] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:10 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:39:10.986455 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e379f61a-f9b0-4d5b-a878-43470dbf1145 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:10.987096 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e379f61a-f9b0-4d5b-a878-43470dbf1145 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:10.993279 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e379f61a-f9b0-4d5b-a878-43470dbf1145 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:10.993764 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e379f61a-f9b0-4d5b-a878-43470dbf1145 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:10.994197 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e379f61a-f9b0-4d5b-a878-43470dbf1145 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:10.994887 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e379f61a-f9b0-4d5b-a878-43470dbf1145 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:10.995334 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e379f61a-f9b0-4d5b-a878-43470dbf1145 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:10.995773 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e379f61a-f9b0-4d5b-a878-43470dbf1145 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:11.152741 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e379f61a-f9b0-4d5b-a878-43470dbf1145 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:11.161017 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e379f61a-f9b0-4d5b-a878-43470dbf1145 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.178676 Aug 22 05:39:11.161584 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 86/164] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:10 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:11.904237 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-503a0b8a-a221-4f50-bb92-119a880fc892 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:11.904844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-503a0b8a-a221-4f50-bb92-119a880fc892 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:11.911264 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-503a0b8a-a221-4f50-bb92-119a880fc892 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:11.911777 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-503a0b8a-a221-4f50-bb92-119a880fc892 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:11.912217 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-503a0b8a-a221-4f50-bb92-119a880fc892 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:11.912887 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-503a0b8a-a221-4f50-bb92-119a880fc892 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:11.913324 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-503a0b8a-a221-4f50-bb92-119a880fc892 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:11.913733 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-503a0b8a-a221-4f50-bb92-119a880fc892 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:11.968282 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f7770532-a6a5-41c5-8d51-8b36aa53115a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:11.969739 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f7770532-a6a5-41c5-8d51-8b36aa53115a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:11.976865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f7770532-a6a5-41c5-8d51-8b36aa53115a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:11.977520 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f7770532-a6a5-41c5-8d51-8b36aa53115a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:11.978127 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f7770532-a6a5-41c5-8d51-8b36aa53115a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:11.979067 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f7770532-a6a5-41c5-8d51-8b36aa53115a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:11.979764 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f7770532-a6a5-41c5-8d51-8b36aa53115a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:11.980248 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f7770532-a6a5-41c5-8d51-8b36aa53115a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:12.089109 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-503a0b8a-a221-4f50-bb92-119a880fc892 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:12.098376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-503a0b8a-a221-4f50-bb92-119a880fc892 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.197670 Aug 22 05:39:12.112018 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 79/165] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:11 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:12.139350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-f7770532-a6a5-41c5-8d51-8b36aa53115a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:12.150550 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f7770532-a6a5-41c5-8d51-8b36aa53115a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.186091 Aug 22 05:39:12.151973 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 87/166] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:11 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:12.182593 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b16a5a13-cda1-4ac4-bad9-c46de6f2f733 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:12.183474 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b16a5a13-cda1-4ac4-bad9-c46de6f2f733 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:12.195744 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b16a5a13-cda1-4ac4-bad9-c46de6f2f733 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:12.197530 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b16a5a13-cda1-4ac4-bad9-c46de6f2f733 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:12.199099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b16a5a13-cda1-4ac4-bad9-c46de6f2f733 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:12.200781 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b16a5a13-cda1-4ac4-bad9-c46de6f2f733 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:12.201271 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b16a5a13-cda1-4ac4-bad9-c46de6f2f733 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:12.201700 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b16a5a13-cda1-4ac4-bad9-c46de6f2f733 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:12.343859 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b16a5a13-cda1-4ac4-bad9-c46de6f2f733 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:12.351791 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b16a5a13-cda1-4ac4-bad9-c46de6f2f733 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.173173 Aug 22 05:39:12.359301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 80/167] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:12 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:13.119929 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-545b3464-af2d-4dbd-8f80-ebe89ea0768d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:13.120578 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-545b3464-af2d-4dbd-8f80-ebe89ea0768d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:13.127308 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-545b3464-af2d-4dbd-8f80-ebe89ea0768d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:13.127808 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-545b3464-af2d-4dbd-8f80-ebe89ea0768d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:13.128230 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-545b3464-af2d-4dbd-8f80-ebe89ea0768d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:13.128904 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-545b3464-af2d-4dbd-8f80-ebe89ea0768d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:13.129344 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-545b3464-af2d-4dbd-8f80-ebe89ea0768d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:13.129760 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-545b3464-af2d-4dbd-8f80-ebe89ea0768d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:13.173289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a6510f0d-814f-46ba-91c3-3e4b2fcba31b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:13.174622 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a6510f0d-814f-46ba-91c3-3e4b2fcba31b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:13.182245 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6510f0d-814f-46ba-91c3-3e4b2fcba31b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:13.183012 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6510f0d-814f-46ba-91c3-3e4b2fcba31b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:13.183437 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6510f0d-814f-46ba-91c3-3e4b2fcba31b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:13.184123 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6510f0d-814f-46ba-91c3-3e4b2fcba31b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:13.184574 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6510f0d-814f-46ba-91c3-3e4b2fcba31b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:13.184972 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6510f0d-814f-46ba-91c3-3e4b2fcba31b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:13.384435 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-545b3464-af2d-4dbd-8f80-ebe89ea0768d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:13.393148 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-545b3464-af2d-4dbd-8f80-ebe89ea0768d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.277256 Aug 22 05:39:13.393959 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 88/168] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:13 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:13.412547 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e75e72f8-e391-4f22-8c04-c8e5a3c1d38b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:13.413172 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e75e72f8-e391-4f22-8c04-c8e5a3c1d38b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:13.421743 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e75e72f8-e391-4f22-8c04-c8e5a3c1d38b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:13.422406 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e75e72f8-e391-4f22-8c04-c8e5a3c1d38b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:13.422924 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e75e72f8-e391-4f22-8c04-c8e5a3c1d38b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:13.423710 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e75e72f8-e391-4f22-8c04-c8e5a3c1d38b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:13.424297 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e75e72f8-e391-4f22-8c04-c8e5a3c1d38b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:13.425087 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e75e72f8-e391-4f22-8c04-c8e5a3c1d38b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:13.433987 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a6510f0d-814f-46ba-91c3-3e4b2fcba31b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:13.446618 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a6510f0d-814f-46ba-91c3-3e4b2fcba31b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.277951 Aug 22 05:39:13.447222 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 81/169] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:13 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:13.558993 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e75e72f8-e391-4f22-8c04-c8e5a3c1d38b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:13.566839 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e75e72f8-e391-4f22-8c04-c8e5a3c1d38b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.159750 Aug 22 05:39:13.567399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 89/170] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:13 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:14.414532 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e741bbbb-cdc3-471e-ad51-7a47aff499b2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:14.415121 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e741bbbb-cdc3-471e-ad51-7a47aff499b2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:14.421355 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e741bbbb-cdc3-471e-ad51-7a47aff499b2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:14.421841 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e741bbbb-cdc3-471e-ad51-7a47aff499b2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:14.422258 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e741bbbb-cdc3-471e-ad51-7a47aff499b2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:14.423127 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e741bbbb-cdc3-471e-ad51-7a47aff499b2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:14.423533 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e741bbbb-cdc3-471e-ad51-7a47aff499b2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:14.423955 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e741bbbb-cdc3-471e-ad51-7a47aff499b2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:14.467777 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-75fe9913-e14d-4c54-afed-5ce5e5f96054 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:14.468762 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-75fe9913-e14d-4c54-afed-5ce5e5f96054 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:14.474887 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-75fe9913-e14d-4c54-afed-5ce5e5f96054 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:14.475365 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-75fe9913-e14d-4c54-afed-5ce5e5f96054 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:14.475826 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-75fe9913-e14d-4c54-afed-5ce5e5f96054 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:14.476513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-75fe9913-e14d-4c54-afed-5ce5e5f96054 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:14.476956 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-75fe9913-e14d-4c54-afed-5ce5e5f96054 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:14.477370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-75fe9913-e14d-4c54-afed-5ce5e5f96054 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:14.787488 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e741bbbb-cdc3-471e-ad51-7a47aff499b2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:14.797223 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e741bbbb-cdc3-471e-ad51-7a47aff499b2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.386287 Aug 22 05:39:14.798334 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 82/171] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:14 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:14.803165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-69ab35e8-78d7-4884-bfa7-a619ee5518e4 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:14.803804 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-69ab35e8-78d7-4884-bfa7-a619ee5518e4 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:14.809884 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-69ab35e8-78d7-4884-bfa7-a619ee5518e4 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:14.810373 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-69ab35e8-78d7-4884-bfa7-a619ee5518e4 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:14.810989 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-69ab35e8-78d7-4884-bfa7-a619ee5518e4 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:14.812098 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-69ab35e8-78d7-4884-bfa7-a619ee5518e4 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:14.812766 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-69ab35e8-78d7-4884-bfa7-a619ee5518e4 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:14.813520 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-69ab35e8-78d7-4884-bfa7-a619ee5518e4 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:14.833695 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-75fe9913-e14d-4c54-afed-5ce5e5f96054 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:14.841721 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-75fe9913-e14d-4c54-afed-5ce5e5f96054 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.377859 Aug 22 05:39:14.842286 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 90/172] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:14 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:39:14.950206 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-69ab35e8-78d7-4884-bfa7-a619ee5518e4 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:14.960039 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-69ab35e8-78d7-4884-bfa7-a619ee5518e4 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.160481 Aug 22 05:39:14.960615 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 83/173] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:14 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:15.822484 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0fe1aed1-4c9d-4374-92d8-be213af65351 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:15.823347 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0fe1aed1-4c9d-4374-92d8-be213af65351 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:15.832733 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0fe1aed1-4c9d-4374-92d8-be213af65351 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:15.833210 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0fe1aed1-4c9d-4374-92d8-be213af65351 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:15.833635 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0fe1aed1-4c9d-4374-92d8-be213af65351 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:15.834332 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0fe1aed1-4c9d-4374-92d8-be213af65351 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:15.834751 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0fe1aed1-4c9d-4374-92d8-be213af65351 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:15.835159 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0fe1aed1-4c9d-4374-92d8-be213af65351 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:15.862593 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a865473f-d2bd-43b2-8fee-8543cc945a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:15.863126 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a865473f-d2bd-43b2-8fee-8543cc945a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:15.869540 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a865473f-d2bd-43b2-8fee-8543cc945a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:15.870025 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a865473f-d2bd-43b2-8fee-8543cc945a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:15.870520 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a865473f-d2bd-43b2-8fee-8543cc945a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:15.871216 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a865473f-d2bd-43b2-8fee-8543cc945a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:15.871703 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a865473f-d2bd-43b2-8fee-8543cc945a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:15.872112 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a865473f-d2bd-43b2-8fee-8543cc945a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:16.017974 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0fe1aed1-4c9d-4374-92d8-be213af65351 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:16.025959 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0fe1aed1-4c9d-4374-92d8-be213af65351 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.210041 Aug 22 05:39:16.026498 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 91/174] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:15 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:16.030864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a89ce972-efb6-4de6-a637-5e35db2c849e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:16.031452 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a89ce972-efb6-4de6-a637-5e35db2c849e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:16.038149 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a89ce972-efb6-4de6-a637-5e35db2c849e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:16.038618 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a89ce972-efb6-4de6-a637-5e35db2c849e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:16.039042 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a89ce972-efb6-4de6-a637-5e35db2c849e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:16.039748 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a89ce972-efb6-4de6-a637-5e35db2c849e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:16.040187 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a89ce972-efb6-4de6-a637-5e35db2c849e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:16.040629 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a89ce972-efb6-4de6-a637-5e35db2c849e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:16.045726 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a865473f-d2bd-43b2-8fee-8543cc945a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:16.053997 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a865473f-d2bd-43b2-8fee-8543cc945a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.195356 Aug 22 05:39:16.054544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 84/175] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:15 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:16.176402 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a89ce972-efb6-4de6-a637-5e35db2c849e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:16.189365 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a89ce972-efb6-4de6-a637-5e35db2c849e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.161540 Aug 22 05:39:16.190356 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 92/176] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:16 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:16.829856 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-fb37a8d2-8867-464f-af83-cb2a6216c4a4 req-bff081a2-a67f-4aae-9d0f-8a662ed9effc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b0897c-3b82-4926-909a-2c34fbcd2a1a", "name": "network-vif-plugged", "status": "completed", "tag": "c621e300-a2f5-4edd-a7c7-b4bf9b5a2cd7"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:39:16.846083 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-fb37a8d2-8867-464f-af83-cb2a6216c4a4 req-bff081a2-a67f-4aae-9d0f-8a662ed9effc service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:16.846651 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-fb37a8d2-8867-464f-af83-cb2a6216c4a4 req-bff081a2-a67f-4aae-9d0f-8a662ed9effc service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:16.847056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-fb37a8d2-8867-464f-af83-cb2a6216c4a4 req-bff081a2-a67f-4aae-9d0f-8a662ed9effc service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:16.859431 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-fb37a8d2-8867-464f-af83-cb2a6216c4a4 req-bff081a2-a67f-4aae-9d0f-8a662ed9effc service nova] Creating event network-vif-plugged:c621e300-a2f5-4edd-a7c7-b4bf9b5a2cd7 for instance 02b0897c-3b82-4926-909a-2c34fbcd2a1a on hv-cinder-85391 Aug 22 05:39:16.866542 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-fb37a8d2-8867-464f-af83-cb2a6216c4a4 req-bff081a2-a67f-4aae-9d0f-8a662ed9effc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041952 Aug 22 05:39:16.868838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 85/177] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:39:17.047167 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6f9abbb0-66e9-462f-b5ae-06d909f655bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:17.047845 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-6f9abbb0-66e9-462f-b5ae-06d909f655bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:17.059621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6f9abbb0-66e9-462f-b5ae-06d909f655bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:17.060213 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6f9abbb0-66e9-462f-b5ae-06d909f655bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:17.060709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6f9abbb0-66e9-462f-b5ae-06d909f655bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:17.062597 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6f9abbb0-66e9-462f-b5ae-06d909f655bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:17.063054 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6f9abbb0-66e9-462f-b5ae-06d909f655bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:17.063477 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6f9abbb0-66e9-462f-b5ae-06d909f655bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:17.078664 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e1f397b8-bcad-4585-9358-8c1b119d2de9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:17.080364 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e1f397b8-bcad-4585-9358-8c1b119d2de9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:17.088839 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e1f397b8-bcad-4585-9358-8c1b119d2de9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:17.090462 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e1f397b8-bcad-4585-9358-8c1b119d2de9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:17.094238 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e1f397b8-bcad-4585-9358-8c1b119d2de9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:17.095289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e1f397b8-bcad-4585-9358-8c1b119d2de9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:17.097196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e1f397b8-bcad-4585-9358-8c1b119d2de9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:17.098256 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e1f397b8-bcad-4585-9358-8c1b119d2de9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:17.308287 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6f9abbb0-66e9-462f-b5ae-06d909f655bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:17.316234 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6f9abbb0-66e9-462f-b5ae-06d909f655bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.273801 Aug 22 05:39:17.316798 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 93/178] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:17 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:17.325625 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a3ec5a32-c483-4c99-be3e-aead194bb770 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:17.327269 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a3ec5a32-c483-4c99-be3e-aead194bb770 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:17.337294 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3ec5a32-c483-4c99-be3e-aead194bb770 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:17.338282 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3ec5a32-c483-4c99-be3e-aead194bb770 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:17.338707 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3ec5a32-c483-4c99-be3e-aead194bb770 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:17.339390 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3ec5a32-c483-4c99-be3e-aead194bb770 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:17.339869 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3ec5a32-c483-4c99-be3e-aead194bb770 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:17.340282 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3ec5a32-c483-4c99-be3e-aead194bb770 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:17.352090 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e1f397b8-bcad-4585-9358-8c1b119d2de9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:17.362290 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e1f397b8-bcad-4585-9358-8c1b119d2de9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.289243 Aug 22 05:39:17.363516 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 86/179] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:17 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:39:17.732616 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a3ec5a32-c483-4c99-be3e-aead194bb770 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:17.743881 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a3ec5a32-c483-4c99-be3e-aead194bb770 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.424313 Aug 22 05:39:17.745408 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 94/180] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:17 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:18.340036 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-658cf60a-36be-4db9-8651-a7dfcc45ab38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:18.340785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-658cf60a-36be-4db9-8651-a7dfcc45ab38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:18.348648 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-658cf60a-36be-4db9-8651-a7dfcc45ab38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:18.349710 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-658cf60a-36be-4db9-8651-a7dfcc45ab38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:18.350247 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-658cf60a-36be-4db9-8651-a7dfcc45ab38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:18.351259 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-658cf60a-36be-4db9-8651-a7dfcc45ab38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:18.351813 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-658cf60a-36be-4db9-8651-a7dfcc45ab38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:18.352301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-658cf60a-36be-4db9-8651-a7dfcc45ab38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:18.387853 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-795c3167-0a8b-41fd-a9d9-d3600da104ca tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:18.391469 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-795c3167-0a8b-41fd-a9d9-d3600da104ca tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:18.401798 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-795c3167-0a8b-41fd-a9d9-d3600da104ca tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:18.402580 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-795c3167-0a8b-41fd-a9d9-d3600da104ca tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:18.403085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-795c3167-0a8b-41fd-a9d9-d3600da104ca tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:18.403938 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-795c3167-0a8b-41fd-a9d9-d3600da104ca tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:18.404748 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-795c3167-0a8b-41fd-a9d9-d3600da104ca tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:18.405238 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-795c3167-0a8b-41fd-a9d9-d3600da104ca tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:18.605142 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-658cf60a-36be-4db9-8651-a7dfcc45ab38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:18.614496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-658cf60a-36be-4db9-8651-a7dfcc45ab38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.280732 Aug 22 05:39:18.615065 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 87/181] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:18 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:18.632640 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-795c3167-0a8b-41fd-a9d9-d3600da104ca tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:18.641595 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-795c3167-0a8b-41fd-a9d9-d3600da104ca tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.260056 Aug 22 05:39:18.642366 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 95/182] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:18 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:39:18.775298 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-903e6b73-9387-42e6-9d69-53fa89cb5548 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:18.776025 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-903e6b73-9387-42e6-9d69-53fa89cb5548 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:18.785254 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-903e6b73-9387-42e6-9d69-53fa89cb5548 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:18.785661 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-903e6b73-9387-42e6-9d69-53fa89cb5548 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:18.786097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-903e6b73-9387-42e6-9d69-53fa89cb5548 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:18.786805 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-903e6b73-9387-42e6-9d69-53fa89cb5548 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:18.787257 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-903e6b73-9387-42e6-9d69-53fa89cb5548 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:18.787875 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-903e6b73-9387-42e6-9d69-53fa89cb5548 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:18.937502 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-903e6b73-9387-42e6-9d69-53fa89cb5548 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:18.945452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-903e6b73-9387-42e6-9d69-53fa89cb5548 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.174435 Aug 22 05:39:18.946022 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 88/183] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:18 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:39:19.643971 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f4a6436e-f615-45ea-a45c-135352da6a34 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:19.643971 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f4a6436e-f615-45ea-a45c-135352da6a34 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:19.643971 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f4a6436e-f615-45ea-a45c-135352da6a34 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:19.643971 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f4a6436e-f615-45ea-a45c-135352da6a34 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:19.644793 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f4a6436e-f615-45ea-a45c-135352da6a34 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:19.644793 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f4a6436e-f615-45ea-a45c-135352da6a34 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:19.644793 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f4a6436e-f615-45ea-a45c-135352da6a34 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:19.644793 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f4a6436e-f615-45ea-a45c-135352da6a34 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:19.662560 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-907367f0-761e-45a4-9746-e0036145bfb9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:19.663821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-907367f0-761e-45a4-9746-e0036145bfb9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:19.670668 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=72 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:39:19.675225 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-907367f0-761e-45a4-9746-e0036145bfb9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:19.676871 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-907367f0-761e-45a4-9746-e0036145bfb9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:19.678922 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-907367f0-761e-45a4-9746-e0036145bfb9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:19.679667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-907367f0-761e-45a4-9746-e0036145bfb9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:19.680128 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-907367f0-761e-45a4-9746-e0036145bfb9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:19.680554 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-907367f0-761e-45a4-9746-e0036145bfb9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:19.868374 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-f4a6436e-f615-45ea-a45c-135352da6a34 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:19.882048 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f4a6436e-f615-45ea-a45c-135352da6a34 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.251572 Aug 22 05:39:19.882924 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 96/184] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:19 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:19.884881 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-907367f0-761e-45a4-9746-e0036145bfb9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:19.893144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-907367f0-761e-45a4-9746-e0036145bfb9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.234877 Aug 22 05:39:19.899623 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 89/185] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:19 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:19.966678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-029160b5-1eae-4e52-8c70-6e5ce40fe4ca tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:19.967523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-029160b5-1eae-4e52-8c70-6e5ce40fe4ca tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:19.975210 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-029160b5-1eae-4e52-8c70-6e5ce40fe4ca tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:19.975922 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-029160b5-1eae-4e52-8c70-6e5ce40fe4ca tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:19.976687 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-029160b5-1eae-4e52-8c70-6e5ce40fe4ca tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:19.977522 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-029160b5-1eae-4e52-8c70-6e5ce40fe4ca tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:19.978347 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-029160b5-1eae-4e52-8c70-6e5ce40fe4ca tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:19.978919 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-029160b5-1eae-4e52-8c70-6e5ce40fe4ca tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:19.999778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=100 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:39:20.124254 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-029160b5-1eae-4e52-8c70-6e5ce40fe4ca tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:20.135031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-029160b5-1eae-4e52-8c70-6e5ce40fe4ca tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.172554 Aug 22 05:39:20.135633 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 97/186] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:19 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:20.912641 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fdd5f289-db2e-45a3-8aff-c13c8c1724d1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:20.913293 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fdd5f289-db2e-45a3-8aff-c13c8c1724d1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:20.917091 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-07641e68-4b4d-4952-8aae-5167b506a36e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:20.917700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-07641e68-4b4d-4952-8aae-5167b506a36e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:20.919222 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fdd5f289-db2e-45a3-8aff-c13c8c1724d1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:20.919920 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fdd5f289-db2e-45a3-8aff-c13c8c1724d1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:20.920506 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fdd5f289-db2e-45a3-8aff-c13c8c1724d1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:20.921682 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fdd5f289-db2e-45a3-8aff-c13c8c1724d1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:20.922124 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fdd5f289-db2e-45a3-8aff-c13c8c1724d1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:20.922544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fdd5f289-db2e-45a3-8aff-c13c8c1724d1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:20.924092 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-07641e68-4b4d-4952-8aae-5167b506a36e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:20.924552 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-07641e68-4b4d-4952-8aae-5167b506a36e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:20.925278 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-07641e68-4b4d-4952-8aae-5167b506a36e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:20.926172 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-07641e68-4b4d-4952-8aae-5167b506a36e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:20.926759 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-07641e68-4b4d-4952-8aae-5167b506a36e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:20.927321 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-07641e68-4b4d-4952-8aae-5167b506a36e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:21.123193 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fdd5f289-db2e-45a3-8aff-c13c8c1724d1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:21.127434 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-07641e68-4b4d-4952-8aae-5167b506a36e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:21.131491 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fdd5f289-db2e-45a3-8aff-c13c8c1724d1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.224025 Aug 22 05:39:21.132437 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 90/187] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:20 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:21.135768 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-07641e68-4b4d-4952-8aae-5167b506a36e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.222920 Aug 22 05:39:21.136792 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 98/188] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:20 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:39:21.155305 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-845603fb-5b33-4cbb-a966-ebbbbc89181f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:21.155876 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-845603fb-5b33-4cbb-a966-ebbbbc89181f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:21.162445 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-845603fb-5b33-4cbb-a966-ebbbbc89181f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:21.162924 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-845603fb-5b33-4cbb-a966-ebbbbc89181f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:21.163380 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-845603fb-5b33-4cbb-a966-ebbbbc89181f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:21.164126 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-845603fb-5b33-4cbb-a966-ebbbbc89181f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:21.164570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-845603fb-5b33-4cbb-a966-ebbbbc89181f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:21.164988 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-845603fb-5b33-4cbb-a966-ebbbbc89181f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:21.182950 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:39:21.303749 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-845603fb-5b33-4cbb-a966-ebbbbc89181f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:21.311402 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-845603fb-5b33-4cbb-a966-ebbbbc89181f tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.160278 Aug 22 05:39:21.311992 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 91/189] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:21 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:22.152332 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-82766d43-4a3c-472d-bf84-3dd967db990a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:22.152944 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-82766d43-4a3c-472d-bf84-3dd967db990a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:22.156645 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-13ba8370-02cd-4436-be42-6b58d6f9c16c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:22.157250 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-13ba8370-02cd-4436-be42-6b58d6f9c16c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:22.159668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82766d43-4a3c-472d-bf84-3dd967db990a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:22.160141 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82766d43-4a3c-472d-bf84-3dd967db990a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:22.160577 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82766d43-4a3c-472d-bf84-3dd967db990a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:22.161275 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82766d43-4a3c-472d-bf84-3dd967db990a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:22.161747 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82766d43-4a3c-472d-bf84-3dd967db990a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:22.162143 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82766d43-4a3c-472d-bf84-3dd967db990a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:22.163765 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-13ba8370-02cd-4436-be42-6b58d6f9c16c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:22.164263 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-13ba8370-02cd-4436-be42-6b58d6f9c16c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:22.164671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-13ba8370-02cd-4436-be42-6b58d6f9c16c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:22.165383 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-13ba8370-02cd-4436-be42-6b58d6f9c16c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:22.165853 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-13ba8370-02cd-4436-be42-6b58d6f9c16c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:22.166281 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-13ba8370-02cd-4436-be42-6b58d6f9c16c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:22.365067 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-82766d43-4a3c-472d-bf84-3dd967db990a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:22.369567 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-13ba8370-02cd-4436-be42-6b58d6f9c16c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:22.373068 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-82766d43-4a3c-472d-bf84-3dd967db990a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.224571 Aug 22 05:39:22.373653 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 99/190] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:22 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:22.377347 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-13ba8370-02cd-4436-be42-6b58d6f9c16c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.224544 Aug 22 05:39:22.378006 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 92/191] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:22 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:22.378154 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4c9e31c9-a9df-4ad3-b44b-45e358229194 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:22.378847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4c9e31c9-a9df-4ad3-b44b-45e358229194 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:22.385018 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c9e31c9-a9df-4ad3-b44b-45e358229194 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:22.385495 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c9e31c9-a9df-4ad3-b44b-45e358229194 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:22.385903 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c9e31c9-a9df-4ad3-b44b-45e358229194 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:22.386619 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c9e31c9-a9df-4ad3-b44b-45e358229194 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:22.387064 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c9e31c9-a9df-4ad3-b44b-45e358229194 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:22.387479 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c9e31c9-a9df-4ad3-b44b-45e358229194 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:22.516401 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4c9e31c9-a9df-4ad3-b44b-45e358229194 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:22.525426 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4c9e31c9-a9df-4ad3-b44b-45e358229194 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.150826 Aug 22 05:39:22.526005 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 100/192] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:22 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:23.397126 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-27943f56-e9c6-4a38-a5aa-6223f429f2bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:23.398684 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-27943f56-e9c6-4a38-a5aa-6223f429f2bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:23.400283 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7507ed64-50ed-493d-9a33-5ec3777a69fe tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:23.401444 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-7507ed64-50ed-493d-9a33-5ec3777a69fe tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:23.405504 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27943f56-e9c6-4a38-a5aa-6223f429f2bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:23.405986 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27943f56-e9c6-4a38-a5aa-6223f429f2bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:23.406488 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27943f56-e9c6-4a38-a5aa-6223f429f2bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:23.407079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27943f56-e9c6-4a38-a5aa-6223f429f2bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:23.407517 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27943f56-e9c6-4a38-a5aa-6223f429f2bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:23.408196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27943f56-e9c6-4a38-a5aa-6223f429f2bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:23.410227 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7507ed64-50ed-493d-9a33-5ec3777a69fe tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:23.410789 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7507ed64-50ed-493d-9a33-5ec3777a69fe tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:23.411293 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7507ed64-50ed-493d-9a33-5ec3777a69fe tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:23.412094 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7507ed64-50ed-493d-9a33-5ec3777a69fe tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:23.412570 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7507ed64-50ed-493d-9a33-5ec3777a69fe tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:23.413217 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7507ed64-50ed-493d-9a33-5ec3777a69fe tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:23.613008 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-7507ed64-50ed-493d-9a33-5ec3777a69fe tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:23.617072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-27943f56-e9c6-4a38-a5aa-6223f429f2bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:23.622300 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-7507ed64-50ed-493d-9a33-5ec3777a69fe tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.227565 Aug 22 05:39:23.623127 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 101/193] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:23 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:23.625326 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-27943f56-e9c6-4a38-a5aa-6223f429f2bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.233967 Aug 22 05:39:23.625861 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 93/194] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:23 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:23.628927 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-93ccf651-ca09-4e60-b275-abbf57c61448 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:23.629720 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-93ccf651-ca09-4e60-b275-abbf57c61448 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:23.635692 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-93ccf651-ca09-4e60-b275-abbf57c61448 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:23.636167 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-93ccf651-ca09-4e60-b275-abbf57c61448 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:23.636617 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-93ccf651-ca09-4e60-b275-abbf57c61448 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:23.637297 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-93ccf651-ca09-4e60-b275-abbf57c61448 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:23.637720 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-93ccf651-ca09-4e60-b275-abbf57c61448 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:23.638128 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-93ccf651-ca09-4e60-b275-abbf57c61448 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:23.776028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-93ccf651-ca09-4e60-b275-abbf57c61448 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:23.784239 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-93ccf651-ca09-4e60-b275-abbf57c61448 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.160120 Aug 22 05:39:23.785105 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 102/195] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:23 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:24.646320 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c78c7dd1-079a-4a3c-a424-2d19cf3058c1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:24.647096 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c78c7dd1-079a-4a3c-a424-2d19cf3058c1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:24.648144 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-00a3b7f5-8707-4b7c-9eda-62d0b187dd75 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:24.648807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-00a3b7f5-8707-4b7c-9eda-62d0b187dd75 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:24.654139 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c78c7dd1-079a-4a3c-a424-2d19cf3058c1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:24.654663 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c78c7dd1-079a-4a3c-a424-2d19cf3058c1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:24.655131 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c78c7dd1-079a-4a3c-a424-2d19cf3058c1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:24.655687 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-00a3b7f5-8707-4b7c-9eda-62d0b187dd75 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:24.655925 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c78c7dd1-079a-4a3c-a424-2d19cf3058c1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:24.656198 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-00a3b7f5-8707-4b7c-9eda-62d0b187dd75 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:24.656396 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c78c7dd1-079a-4a3c-a424-2d19cf3058c1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:24.656668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-00a3b7f5-8707-4b7c-9eda-62d0b187dd75 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:24.656851 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c78c7dd1-079a-4a3c-a424-2d19cf3058c1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:24.657421 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-00a3b7f5-8707-4b7c-9eda-62d0b187dd75 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:24.657915 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-00a3b7f5-8707-4b7c-9eda-62d0b187dd75 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:24.658365 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-00a3b7f5-8707-4b7c-9eda-62d0b187dd75 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:24.856026 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c78c7dd1-079a-4a3c-a424-2d19cf3058c1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:24.859728 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-00a3b7f5-8707-4b7c-9eda-62d0b187dd75 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:24.865929 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c78c7dd1-079a-4a3c-a424-2d19cf3058c1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.225082 Aug 22 05:39:24.866581 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 94/196] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:24 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:24.871051 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-00a3b7f5-8707-4b7c-9eda-62d0b187dd75 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.227277 Aug 22 05:39:24.871659 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 103/197] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:24 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:24.877577 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3852554e-ae60-467f-aa2b-c0194ec30bd6 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:24.878642 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3852554e-ae60-467f-aa2b-c0194ec30bd6 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:24.884708 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3852554e-ae60-467f-aa2b-c0194ec30bd6 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:24.885213 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3852554e-ae60-467f-aa2b-c0194ec30bd6 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:24.885640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3852554e-ae60-467f-aa2b-c0194ec30bd6 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:24.886323 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3852554e-ae60-467f-aa2b-c0194ec30bd6 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:24.886769 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3852554e-ae60-467f-aa2b-c0194ec30bd6 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:24.887214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3852554e-ae60-467f-aa2b-c0194ec30bd6 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:25.023213 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3852554e-ae60-467f-aa2b-c0194ec30bd6 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:25.034833 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3852554e-ae60-467f-aa2b-c0194ec30bd6 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.167099 Aug 22 05:39:25.035396 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 95/198] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:24 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:25.886585 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4d295c9e-2531-4ac5-a6de-c87a43a65a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:25.887190 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4d295c9e-2531-4ac5-a6de-c87a43a65a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:25.891244 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f5243190-d7c1-4d6a-9973-1e7f3982bc1b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:25.891931 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f5243190-d7c1-4d6a-9973-1e7f3982bc1b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:25.899558 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4d295c9e-2531-4ac5-a6de-c87a43a65a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:25.899558 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4d295c9e-2531-4ac5-a6de-c87a43a65a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:25.899558 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4d295c9e-2531-4ac5-a6de-c87a43a65a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:25.899558 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4d295c9e-2531-4ac5-a6de-c87a43a65a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:25.899873 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5243190-d7c1-4d6a-9973-1e7f3982bc1b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:25.899948 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4d295c9e-2531-4ac5-a6de-c87a43a65a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:25.899948 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4d295c9e-2531-4ac5-a6de-c87a43a65a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:25.900092 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5243190-d7c1-4d6a-9973-1e7f3982bc1b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:25.900092 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5243190-d7c1-4d6a-9973-1e7f3982bc1b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:25.900738 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5243190-d7c1-4d6a-9973-1e7f3982bc1b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:25.900738 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5243190-d7c1-4d6a-9973-1e7f3982bc1b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:25.901144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5243190-d7c1-4d6a-9973-1e7f3982bc1b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:26.094485 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f5243190-d7c1-4d6a-9973-1e7f3982bc1b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:26.099951 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4d295c9e-2531-4ac5-a6de-c87a43a65a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:26.104936 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f5243190-d7c1-4d6a-9973-1e7f3982bc1b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.217279 Aug 22 05:39:26.105590 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 96/199] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:25 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:39:26.109696 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4d295c9e-2531-4ac5-a6de-c87a43a65a48 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.226834 Aug 22 05:39:26.110227 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 104/200] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:25 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:26.117963 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6ea62ed0-9b40-4db3-82aa-c16ec60bbe9c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:26.118561 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6ea62ed0-9b40-4db3-82aa-c16ec60bbe9c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:26.125097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6ea62ed0-9b40-4db3-82aa-c16ec60bbe9c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:26.125609 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6ea62ed0-9b40-4db3-82aa-c16ec60bbe9c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:26.126107 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6ea62ed0-9b40-4db3-82aa-c16ec60bbe9c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:26.126812 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6ea62ed0-9b40-4db3-82aa-c16ec60bbe9c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:26.127922 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6ea62ed0-9b40-4db3-82aa-c16ec60bbe9c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:26.128347 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6ea62ed0-9b40-4db3-82aa-c16ec60bbe9c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:26.270707 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6ea62ed0-9b40-4db3-82aa-c16ec60bbe9c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:26.278721 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6ea62ed0-9b40-4db3-82aa-c16ec60bbe9c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.172160 Aug 22 05:39:26.279294 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 97/201] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:26 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:27.126127 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-dd730b1e-13b2-4f7f-adc9-b9edd084bbe3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:27.126693 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-dd730b1e-13b2-4f7f-adc9-b9edd084bbe3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:27.131400 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8f2b874f-436d-44e5-9be6-c612ab6ec088 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:27.132046 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8f2b874f-436d-44e5-9be6-c612ab6ec088 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:27.133741 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd730b1e-13b2-4f7f-adc9-b9edd084bbe3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:27.134213 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd730b1e-13b2-4f7f-adc9-b9edd084bbe3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:27.134666 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd730b1e-13b2-4f7f-adc9-b9edd084bbe3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:27.135352 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd730b1e-13b2-4f7f-adc9-b9edd084bbe3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:27.135833 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd730b1e-13b2-4f7f-adc9-b9edd084bbe3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:27.136253 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd730b1e-13b2-4f7f-adc9-b9edd084bbe3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:27.138176 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f2b874f-436d-44e5-9be6-c612ab6ec088 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:27.138680 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f2b874f-436d-44e5-9be6-c612ab6ec088 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:27.139124 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f2b874f-436d-44e5-9be6-c612ab6ec088 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:27.139829 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f2b874f-436d-44e5-9be6-c612ab6ec088 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:27.140242 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f2b874f-436d-44e5-9be6-c612ab6ec088 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:27.140683 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f2b874f-436d-44e5-9be6-c612ab6ec088 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:27.335834 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-dd730b1e-13b2-4f7f-adc9-b9edd084bbe3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:27.342529 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8f2b874f-436d-44e5-9be6-c612ab6ec088 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:27.344186 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-dd730b1e-13b2-4f7f-adc9-b9edd084bbe3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.221955 Aug 22 05:39:27.344746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 105/202] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:27 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:27.349381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-de41d9eb-0f6b-437e-a2ec-2716fbb769e5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:27.349983 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-de41d9eb-0f6b-437e-a2ec-2716fbb769e5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:27.351947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8f2b874f-436d-44e5-9be6-c612ab6ec088 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.225396 Aug 22 05:39:27.352911 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 98/203] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:27 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:27.362924 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-de41d9eb-0f6b-437e-a2ec-2716fbb769e5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:27.363410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-de41d9eb-0f6b-437e-a2ec-2716fbb769e5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:27.364012 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-de41d9eb-0f6b-437e-a2ec-2716fbb769e5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:27.364737 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-de41d9eb-0f6b-437e-a2ec-2716fbb769e5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:27.365190 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-de41d9eb-0f6b-437e-a2ec-2716fbb769e5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:27.365611 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-de41d9eb-0f6b-437e-a2ec-2716fbb769e5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:27.507480 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-de41d9eb-0f6b-437e-a2ec-2716fbb769e5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:27.515353 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-de41d9eb-0f6b-437e-a2ec-2716fbb769e5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.169626 Aug 22 05:39:27.515973 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 106/204] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:27 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:28.367264 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-10108a42-4e52-4177-bd91-e61a1cb6b2f4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:28.367893 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-10108a42-4e52-4177-bd91-e61a1cb6b2f4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:28.374861 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-10108a42-4e52-4177-bd91-e61a1cb6b2f4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:28.375233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-04ef7960-5a8b-4dda-8f8d-126d80ffc721 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:28.375826 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-10108a42-4e52-4177-bd91-e61a1cb6b2f4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:28.376053 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-10108a42-4e52-4177-bd91-e61a1cb6b2f4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:28.376150 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-04ef7960-5a8b-4dda-8f8d-126d80ffc721 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:28.376630 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-10108a42-4e52-4177-bd91-e61a1cb6b2f4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:28.377283 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-10108a42-4e52-4177-bd91-e61a1cb6b2f4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:28.377804 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-10108a42-4e52-4177-bd91-e61a1cb6b2f4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:28.383664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04ef7960-5a8b-4dda-8f8d-126d80ffc721 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:28.384189 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04ef7960-5a8b-4dda-8f8d-126d80ffc721 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:28.384595 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04ef7960-5a8b-4dda-8f8d-126d80ffc721 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:28.385296 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04ef7960-5a8b-4dda-8f8d-126d80ffc721 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:28.385747 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04ef7960-5a8b-4dda-8f8d-126d80ffc721 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:28.386166 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04ef7960-5a8b-4dda-8f8d-126d80ffc721 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:28.575072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-10108a42-4e52-4177-bd91-e61a1cb6b2f4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:28.579225 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-04ef7960-5a8b-4dda-8f8d-126d80ffc721 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:28.583679 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-10108a42-4e52-4177-bd91-e61a1cb6b2f4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.220496 Aug 22 05:39:28.584200 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 99/205] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:28 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:28.587396 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-04ef7960-5a8b-4dda-8f8d-126d80ffc721 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.217157 Aug 22 05:39:28.588148 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 107/206] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:28 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:28.588853 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-66d52050-d66c-42fc-821d-b14d71251a51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:28.589459 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-66d52050-d66c-42fc-821d-b14d71251a51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:28.595713 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-66d52050-d66c-42fc-821d-b14d71251a51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:28.596247 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-66d52050-d66c-42fc-821d-b14d71251a51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:28.596834 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-66d52050-d66c-42fc-821d-b14d71251a51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:28.597673 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-66d52050-d66c-42fc-821d-b14d71251a51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:28.598122 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-66d52050-d66c-42fc-821d-b14d71251a51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:28.599127 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-66d52050-d66c-42fc-821d-b14d71251a51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:28.736704 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-66d52050-d66c-42fc-821d-b14d71251a51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:28.748641 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-66d52050-d66c-42fc-821d-b14d71251a51 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.163190 Aug 22 05:39:28.749489 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 100/207] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:28 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:29.604965 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c506db38-4f09-488d-b0bc-967ed66e433f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:29.606432 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c506db38-4f09-488d-b0bc-967ed66e433f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:29.608506 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e43ebd87-1c58-4554-8115-dfe3b22b5701 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:29.609399 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e43ebd87-1c58-4554-8115-dfe3b22b5701 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:29.613576 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c506db38-4f09-488d-b0bc-967ed66e433f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:29.614322 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c506db38-4f09-488d-b0bc-967ed66e433f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:29.614946 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c506db38-4f09-488d-b0bc-967ed66e433f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:29.615859 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c506db38-4f09-488d-b0bc-967ed66e433f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:29.615990 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e43ebd87-1c58-4554-8115-dfe3b22b5701 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:29.616418 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e43ebd87-1c58-4554-8115-dfe3b22b5701 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:29.616807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c506db38-4f09-488d-b0bc-967ed66e433f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:29.617125 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e43ebd87-1c58-4554-8115-dfe3b22b5701 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:29.617597 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c506db38-4f09-488d-b0bc-967ed66e433f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:29.617952 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e43ebd87-1c58-4554-8115-dfe3b22b5701 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:29.618727 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e43ebd87-1c58-4554-8115-dfe3b22b5701 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:29.619241 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e43ebd87-1c58-4554-8115-dfe3b22b5701 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:29.818225 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c506db38-4f09-488d-b0bc-967ed66e433f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:29.827543 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c506db38-4f09-488d-b0bc-967ed66e433f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.226380 Aug 22 05:39:29.828284 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 108/208] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:29 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:29.832751 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e43ebd87-1c58-4554-8115-dfe3b22b5701 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:29.833029 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-fe0cf9ea-599b-4daa-a9fc-a211e0e2cfe3 req-6f465a41-a337-4ebe-9dd7-ba3b39819655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09fac986-176b-43b6-a4c4-c32b1513a3bf", "name": "network-vif-plugged", "status": "completed", "tag": "11155cdc-4e7d-4c79-b482-df219fb67393"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:39:29.842514 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-fe0cf9ea-599b-4daa-a9fc-a211e0e2cfe3 req-6f465a41-a337-4ebe-9dd7-ba3b39819655 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:29.842677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e43ebd87-1c58-4554-8115-dfe3b22b5701 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.238043 Aug 22 05:39:29.843492 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 101/209] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:29 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:29.843840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-fe0cf9ea-599b-4daa-a9fc-a211e0e2cfe3 req-6f465a41-a337-4ebe-9dd7-ba3b39819655 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:29.844446 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-fe0cf9ea-599b-4daa-a9fc-a211e0e2cfe3 req-6f465a41-a337-4ebe-9dd7-ba3b39819655 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:29.848322 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8b1ebc2e-e916-487e-a420-1b25ce0d14cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:29.848900 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8b1ebc2e-e916-487e-a420-1b25ce0d14cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:29.855400 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8b1ebc2e-e916-487e-a420-1b25ce0d14cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:29.855916 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8b1ebc2e-e916-487e-a420-1b25ce0d14cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:29.856338 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8b1ebc2e-e916-487e-a420-1b25ce0d14cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:29.857226 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-fe0cf9ea-599b-4daa-a9fc-a211e0e2cfe3 req-6f465a41-a337-4ebe-9dd7-ba3b39819655 service nova] Creating event network-vif-plugged:11155cdc-4e7d-4c79-b482-df219fb67393 for instance 09fac986-176b-43b6-a4c4-c32b1513a3bf on hv-cinder-85391 Aug 22 05:39:29.857367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8b1ebc2e-e916-487e-a420-1b25ce0d14cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:29.857700 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8b1ebc2e-e916-487e-a420-1b25ce0d14cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:29.858175 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8b1ebc2e-e916-487e-a420-1b25ce0d14cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:29.862765 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-fe0cf9ea-599b-4daa-a9fc-a211e0e2cfe3 req-6f465a41-a337-4ebe-9dd7-ba3b39819655 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033306 Aug 22 05:39:29.863388 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 109/210] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:39:29.997540 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8b1ebc2e-e916-487e-a420-1b25ce0d14cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:30.005838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8b1ebc2e-e916-487e-a420-1b25ce0d14cc tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.161327 Aug 22 05:39:30.006413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 102/211] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:29 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:30.849453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-689cd5a8-9ce7-4e66-9123-c9b3193777b7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:30.850147 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-689cd5a8-9ce7-4e66-9123-c9b3193777b7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:30.856386 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-689cd5a8-9ce7-4e66-9123-c9b3193777b7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:30.856868 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-689cd5a8-9ce7-4e66-9123-c9b3193777b7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:30.857301 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-689cd5a8-9ce7-4e66-9123-c9b3193777b7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:30.857995 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-689cd5a8-9ce7-4e66-9123-c9b3193777b7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:30.858518 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-689cd5a8-9ce7-4e66-9123-c9b3193777b7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:30.858937 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-689cd5a8-9ce7-4e66-9123-c9b3193777b7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:30.868197 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3e96cde0-9dd4-4c22-991a-23736285ed2d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:30.869609 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3e96cde0-9dd4-4c22-991a-23736285ed2d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:30.875733 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3e96cde0-9dd4-4c22-991a-23736285ed2d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:30.876302 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3e96cde0-9dd4-4c22-991a-23736285ed2d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:30.876952 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3e96cde0-9dd4-4c22-991a-23736285ed2d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:30.877713 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3e96cde0-9dd4-4c22-991a-23736285ed2d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:30.878351 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3e96cde0-9dd4-4c22-991a-23736285ed2d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:30.878967 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3e96cde0-9dd4-4c22-991a-23736285ed2d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:31.090004 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-689cd5a8-9ce7-4e66-9123-c9b3193777b7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:31.098520 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-689cd5a8-9ce7-4e66-9123-c9b3193777b7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.253831 Aug 22 05:39:31.099342 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3e96cde0-9dd4-4c22-991a-23736285ed2d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:31.099472 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 110/212] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:30 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:31.104073 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-bf7b679b-cbda-4102-9b83-c7a73261423e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:31.104633 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-bf7b679b-cbda-4102-9b83-c7a73261423e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:31.110341 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bf7b679b-cbda-4102-9b83-c7a73261423e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:31.111000 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bf7b679b-cbda-4102-9b83-c7a73261423e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:31.111495 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bf7b679b-cbda-4102-9b83-c7a73261423e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:31.112207 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bf7b679b-cbda-4102-9b83-c7a73261423e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:31.112646 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bf7b679b-cbda-4102-9b83-c7a73261423e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:31.113048 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bf7b679b-cbda-4102-9b83-c7a73261423e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:31.125813 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3e96cde0-9dd4-4c22-991a-23736285ed2d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.263242 Aug 22 05:39:31.138805 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 103/213] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:30 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:31.510162 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-bf7b679b-cbda-4102-9b83-c7a73261423e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:31.519471 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-bf7b679b-cbda-4102-9b83-c7a73261423e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.418831 Aug 22 05:39:31.520289 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 111/214] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:31 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:32.122142 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-54dd7108-777e-4f42-8057-9ccce13cf215 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:32.122766 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-54dd7108-777e-4f42-8057-9ccce13cf215 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:32.129192 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54dd7108-777e-4f42-8057-9ccce13cf215 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:32.129689 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54dd7108-777e-4f42-8057-9ccce13cf215 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:32.130167 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54dd7108-777e-4f42-8057-9ccce13cf215 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:32.131022 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54dd7108-777e-4f42-8057-9ccce13cf215 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:32.131672 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54dd7108-777e-4f42-8057-9ccce13cf215 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:32.132095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54dd7108-777e-4f42-8057-9ccce13cf215 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:32.148012 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8b53b290-9704-4b51-a25e-74e7824d79e4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:32.149769 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8b53b290-9704-4b51-a25e-74e7824d79e4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:32.157583 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b53b290-9704-4b51-a25e-74e7824d79e4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:32.158104 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b53b290-9704-4b51-a25e-74e7824d79e4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:32.158822 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b53b290-9704-4b51-a25e-74e7824d79e4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:32.160658 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b53b290-9704-4b51-a25e-74e7824d79e4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:32.161376 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b53b290-9704-4b51-a25e-74e7824d79e4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:32.161797 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b53b290-9704-4b51-a25e-74e7824d79e4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:32.325440 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-54dd7108-777e-4f42-8057-9ccce13cf215 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:32.334388 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-54dd7108-777e-4f42-8057-9ccce13cf215 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.215937 Aug 22 05:39:32.335413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 104/215] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:32 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:32.379269 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8b53b290-9704-4b51-a25e-74e7824d79e4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:32.388484 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8b53b290-9704-4b51-a25e-74e7824d79e4 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.245995 Aug 22 05:39:32.389153 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 112/216] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:32 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:39:32.541546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2449a84e-73ef-493a-aa35-04bb6d321d8d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:32.542169 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2449a84e-73ef-493a-aa35-04bb6d321d8d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:32.548972 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2449a84e-73ef-493a-aa35-04bb6d321d8d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:32.549457 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2449a84e-73ef-493a-aa35-04bb6d321d8d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:32.549862 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2449a84e-73ef-493a-aa35-04bb6d321d8d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:32.550560 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2449a84e-73ef-493a-aa35-04bb6d321d8d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:32.551043 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2449a84e-73ef-493a-aa35-04bb6d321d8d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:32.551677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2449a84e-73ef-493a-aa35-04bb6d321d8d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:32.706006 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2449a84e-73ef-493a-aa35-04bb6d321d8d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:32.713956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2449a84e-73ef-493a-aa35-04bb6d321d8d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.176466 Aug 22 05:39:32.719917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 105/217] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:32 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:33.355731 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b6372cb2-af4f-4c11-a1d6-416d504cacff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:33.356385 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b6372cb2-af4f-4c11-a1d6-416d504cacff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:33.362445 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b6372cb2-af4f-4c11-a1d6-416d504cacff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:33.362918 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b6372cb2-af4f-4c11-a1d6-416d504cacff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:33.363332 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b6372cb2-af4f-4c11-a1d6-416d504cacff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:33.364035 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b6372cb2-af4f-4c11-a1d6-416d504cacff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:33.364622 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b6372cb2-af4f-4c11-a1d6-416d504cacff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:33.365169 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b6372cb2-af4f-4c11-a1d6-416d504cacff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:33.410111 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-46c56f2a-9469-4f8b-9589-63ba81461413 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:33.411153 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-46c56f2a-9469-4f8b-9589-63ba81461413 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:33.417560 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-46c56f2a-9469-4f8b-9589-63ba81461413 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:33.418325 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-46c56f2a-9469-4f8b-9589-63ba81461413 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:33.418755 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-46c56f2a-9469-4f8b-9589-63ba81461413 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:33.419443 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-46c56f2a-9469-4f8b-9589-63ba81461413 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:33.420145 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-46c56f2a-9469-4f8b-9589-63ba81461413 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:33.420703 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-46c56f2a-9469-4f8b-9589-63ba81461413 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:33.562132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b6372cb2-af4f-4c11-a1d6-416d504cacff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:33.570353 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b6372cb2-af4f-4c11-a1d6-416d504cacff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.218538 Aug 22 05:39:33.570929 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 113/218] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:33 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:33.610875 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-46c56f2a-9469-4f8b-9589-63ba81461413 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:33.618735 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-46c56f2a-9469-4f8b-9589-63ba81461413 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.212622 Aug 22 05:39:33.632409 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 106/219] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:33 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:39:33.736032 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-3517970f-d5b1-4e16-9513-8b2b4424342c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:33.736678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-3517970f-d5b1-4e16-9513-8b2b4424342c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:33.742896 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3517970f-d5b1-4e16-9513-8b2b4424342c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:33.743586 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3517970f-d5b1-4e16-9513-8b2b4424342c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:33.744070 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3517970f-d5b1-4e16-9513-8b2b4424342c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:33.744715 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3517970f-d5b1-4e16-9513-8b2b4424342c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:33.745309 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3517970f-d5b1-4e16-9513-8b2b4424342c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:33.745755 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3517970f-d5b1-4e16-9513-8b2b4424342c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:33.917968 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-3517970f-d5b1-4e16-9513-8b2b4424342c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:33.922483 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=100 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:39:33.927931 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-3517970f-d5b1-4e16-9513-8b2b4424342c tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.195570 Aug 22 05:39:33.928701 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 114/220] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:33 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:34.591209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7f25a57c-e3dc-4217-bc51-bd7923335ef9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:34.591941 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7f25a57c-e3dc-4217-bc51-bd7923335ef9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:34.598627 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f25a57c-e3dc-4217-bc51-bd7923335ef9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:34.599298 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f25a57c-e3dc-4217-bc51-bd7923335ef9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:34.599699 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f25a57c-e3dc-4217-bc51-bd7923335ef9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:34.600385 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f25a57c-e3dc-4217-bc51-bd7923335ef9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:34.600828 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f25a57c-e3dc-4217-bc51-bd7923335ef9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:34.601239 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f25a57c-e3dc-4217-bc51-bd7923335ef9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:34.640838 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-876bc46a-6d38-4a9b-a287-8dc9f473593e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:34.641463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-876bc46a-6d38-4a9b-a287-8dc9f473593e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:34.649383 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-876bc46a-6d38-4a9b-a287-8dc9f473593e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:34.649869 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-876bc46a-6d38-4a9b-a287-8dc9f473593e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:34.650297 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-876bc46a-6d38-4a9b-a287-8dc9f473593e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:34.650990 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-876bc46a-6d38-4a9b-a287-8dc9f473593e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:34.651434 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-876bc46a-6d38-4a9b-a287-8dc9f473593e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:34.651872 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-876bc46a-6d38-4a9b-a287-8dc9f473593e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:34.785881 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7f25a57c-e3dc-4217-bc51-bd7923335ef9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:34.798310 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7f25a57c-e3dc-4217-bc51-bd7923335ef9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.211614 Aug 22 05:39:34.798901 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 107/221] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:34 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:34.847531 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-876bc46a-6d38-4a9b-a287-8dc9f473593e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:34.856699 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-876bc46a-6d38-4a9b-a287-8dc9f473593e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.219876 Aug 22 05:39:34.867748 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 115/222] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:34 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:39:34.953349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6f888df0-3b99-477c-bf4e-02983386f931 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:34.954451 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6f888df0-3b99-477c-bf4e-02983386f931 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:34.965265 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6f888df0-3b99-477c-bf4e-02983386f931 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:34.966047 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6f888df0-3b99-477c-bf4e-02983386f931 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:34.966751 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6f888df0-3b99-477c-bf4e-02983386f931 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:34.968266 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6f888df0-3b99-477c-bf4e-02983386f931 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:34.969042 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6f888df0-3b99-477c-bf4e-02983386f931 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:34.969726 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6f888df0-3b99-477c-bf4e-02983386f931 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:34.975697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:39:35.108850 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6f888df0-3b99-477c-bf4e-02983386f931 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:35.118210 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6f888df0-3b99-477c-bf4e-02983386f931 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.171432 Aug 22 05:39:35.118778 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 108/223] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:34 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:35.821416 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0129e451-0a1f-46cb-b149-923d6eee0e2b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:35.822951 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0129e451-0a1f-46cb-b149-923d6eee0e2b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:35.832427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0129e451-0a1f-46cb-b149-923d6eee0e2b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:35.833112 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0129e451-0a1f-46cb-b149-923d6eee0e2b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:35.834061 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0129e451-0a1f-46cb-b149-923d6eee0e2b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:35.835388 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0129e451-0a1f-46cb-b149-923d6eee0e2b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:35.836142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0129e451-0a1f-46cb-b149-923d6eee0e2b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:35.837424 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0129e451-0a1f-46cb-b149-923d6eee0e2b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:35.879986 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4619e62b-3af9-4233-8e12-68ecc3e12296 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:35.884953 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4619e62b-3af9-4233-8e12-68ecc3e12296 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:35.909314 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4619e62b-3af9-4233-8e12-68ecc3e12296 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:35.916184 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4619e62b-3af9-4233-8e12-68ecc3e12296 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:35.916665 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4619e62b-3af9-4233-8e12-68ecc3e12296 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:35.920534 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4619e62b-3af9-4233-8e12-68ecc3e12296 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:35.921888 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4619e62b-3af9-4233-8e12-68ecc3e12296 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:35.922318 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4619e62b-3af9-4233-8e12-68ecc3e12296 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:36.179736 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0129e451-0a1f-46cb-b149-923d6eee0e2b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:36.188716 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0129e451-0a1f-46cb-b149-923d6eee0e2b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1321 microversion: 2.1 time: 0.372991 Aug 22 05:39:36.189495 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 116/224] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:35 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:39:36.194811 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-cfacf0cf-9c17-41dd-97fd-921a4bde2319 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:36.195568 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-cfacf0cf-9c17-41dd-97fd-921a4bde2319 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:36.203234 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cfacf0cf-9c17-41dd-97fd-921a4bde2319 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:36.204175 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cfacf0cf-9c17-41dd-97fd-921a4bde2319 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:36.205480 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cfacf0cf-9c17-41dd-97fd-921a4bde2319 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:36.206350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cfacf0cf-9c17-41dd-97fd-921a4bde2319 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:36.208692 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cfacf0cf-9c17-41dd-97fd-921a4bde2319 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:36.209906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cfacf0cf-9c17-41dd-97fd-921a4bde2319 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:36.228004 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4619e62b-3af9-4233-8e12-68ecc3e12296 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:36.236924 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4619e62b-3af9-4233-8e12-68ecc3e12296 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.363360 Aug 22 05:39:36.249979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 109/225] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:35 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:36.387002 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-cfacf0cf-9c17-41dd-97fd-921a4bde2319 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:36.395345 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-cfacf0cf-9c17-41dd-97fd-921a4bde2319 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.204580 Aug 22 05:39:36.396758 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 117/226] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:36 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:37.213545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a3545d46-f6d4-4248-aec7-ad71ff013c50 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:37.214380 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a3545d46-f6d4-4248-aec7-ad71ff013c50 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:37.224596 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3545d46-f6d4-4248-aec7-ad71ff013c50 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:37.225304 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3545d46-f6d4-4248-aec7-ad71ff013c50 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:37.225807 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3545d46-f6d4-4248-aec7-ad71ff013c50 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:37.226541 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3545d46-f6d4-4248-aec7-ad71ff013c50 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:37.227027 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3545d46-f6d4-4248-aec7-ad71ff013c50 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:37.227436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3545d46-f6d4-4248-aec7-ad71ff013c50 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:37.258132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-adf65f69-fd69-4460-8cd9-b3b08a3ae37f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:37.259012 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-adf65f69-fd69-4460-8cd9-b3b08a3ae37f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:37.267088 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-adf65f69-fd69-4460-8cd9-b3b08a3ae37f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:37.267829 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-adf65f69-fd69-4460-8cd9-b3b08a3ae37f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:37.268263 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-adf65f69-fd69-4460-8cd9-b3b08a3ae37f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:37.268981 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-adf65f69-fd69-4460-8cd9-b3b08a3ae37f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:37.269599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-adf65f69-fd69-4460-8cd9-b3b08a3ae37f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:37.270181 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-adf65f69-fd69-4460-8cd9-b3b08a3ae37f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:37.423236 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a3545d46-f6d4-4248-aec7-ad71ff013c50 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:37.434312 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a3545d46-f6d4-4248-aec7-ad71ff013c50 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1514 microversion: 2.1 time: 0.225206 Aug 22 05:39:37.435074 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 110/227] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:37 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1514 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:37.440173 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-abd827f5-07cc-4d31-b535-3388630ce275 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:37.440971 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-abd827f5-07cc-4d31-b535-3388630ce275 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:37.447400 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-abd827f5-07cc-4d31-b535-3388630ce275 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:37.448035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-abd827f5-07cc-4d31-b535-3388630ce275 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:37.448667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-abd827f5-07cc-4d31-b535-3388630ce275 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:37.449510 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-abd827f5-07cc-4d31-b535-3388630ce275 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:37.450115 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-abd827f5-07cc-4d31-b535-3388630ce275 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:37.450693 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-abd827f5-07cc-4d31-b535-3388630ce275 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:37.466307 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-adf65f69-fd69-4460-8cd9-b3b08a3ae37f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:37.476247 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-adf65f69-fd69-4460-8cd9-b3b08a3ae37f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.222549 Aug 22 05:39:37.477128 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 118/228] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:37 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:39:37.482249 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f297dd31-f832-4747-a7b9-9daf020f8f9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:39:37.484667 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f297dd31-f832-4747-a7b9-9daf020f8f9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:37.502968 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f297dd31-f832-4747-a7b9-9daf020f8f9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:37.514281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f297dd31-f832-4747-a7b9-9daf020f8f9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:37.515097 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f297dd31-f832-4747-a7b9-9daf020f8f9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:37.516653 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f297dd31-f832-4747-a7b9-9daf020f8f9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:37.517356 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f297dd31-f832-4747-a7b9-9daf020f8f9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:37.518401 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f297dd31-f832-4747-a7b9-9daf020f8f9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:37.616753 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-abd827f5-07cc-4d31-b535-3388630ce275 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:37.626281 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-abd827f5-07cc-4d31-b535-3388630ce275 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.188996 Aug 22 05:39:37.626954 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 111/229] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:37 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:37.636820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.objects.instance [None req-f297dd31-f832-4747-a7b9-9daf020f8f9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lazy-loading 'flavor' on Instance uuid 02b0897c-3b82-4926-909a-2c34fbcd2a1a {{(pid=132497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:39:37.754125 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-ad60b5c1-19dc-4476-9fcd-25e8551cd417 req-7fd6ac6a-645a-4ac0-9181-106bd2f1243a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "585fdc4d-a711-4748-9480-bb5a9bab88f4", "name": "network-vif-plugged", "status": "completed", "tag": "1b1f5f40-5b3a-4135-85ac-8b7ecf8f98f5"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:39:37.817732 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-ad60b5c1-19dc-4476-9fcd-25e8551cd417 req-7fd6ac6a-645a-4ac0-9181-106bd2f1243a service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:37.824185 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-ad60b5c1-19dc-4476-9fcd-25e8551cd417 req-7fd6ac6a-645a-4ac0-9181-106bd2f1243a service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:37.827983 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-ad60b5c1-19dc-4476-9fcd-25e8551cd417 req-7fd6ac6a-645a-4ac0-9181-106bd2f1243a service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:37.828601 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f297dd31-f832-4747-a7b9-9daf020f8f9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "POST /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a/action" status: 200 len: 32 microversion: 2.1 time: 0.349710 Aug 22 05:39:37.829481 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 119/230] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 22 05:39:37 2022] POST /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a/action => generated 32 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 05:39:37.842570 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a8e4e5d1-0679-4694-b2f9-f14272b6d4c4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:37.844284 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a8e4e5d1-0679-4694-b2f9-f14272b6d4c4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:37.847787 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-ad60b5c1-19dc-4476-9fcd-25e8551cd417 req-7fd6ac6a-645a-4ac0-9181-106bd2f1243a service nova] Creating event network-vif-plugged:1b1f5f40-5b3a-4135-85ac-8b7ecf8f98f5 for instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 on hv-cinder-85391 Aug 22 05:39:37.854138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-ad60b5c1-19dc-4476-9fcd-25e8551cd417 req-7fd6ac6a-645a-4ac0-9181-106bd2f1243a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110305 Aug 22 05:39:37.858188 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a8e4e5d1-0679-4694-b2f9-f14272b6d4c4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:37.859080 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a8e4e5d1-0679-4694-b2f9-f14272b6d4c4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:37.860056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 112/231] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:39:37.860323 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a8e4e5d1-0679-4694-b2f9-f14272b6d4c4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:37.861834 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a8e4e5d1-0679-4694-b2f9-f14272b6d4c4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:37.862437 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a8e4e5d1-0679-4694-b2f9-f14272b6d4c4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:37.863266 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a8e4e5d1-0679-4694-b2f9-f14272b6d4c4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:38.045298 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a8e4e5d1-0679-4694-b2f9-f14272b6d4c4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:38.054420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a8e4e5d1-0679-4694-b2f9-f14272b6d4c4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.218599 Aug 22 05:39:38.055778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 120/232] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:37 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:38.501981 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1d86f1f9-831b-4bf0-bc04-9961a1fb5a71 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:38.515392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1d86f1f9-831b-4bf0-bc04-9961a1fb5a71 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:38.524996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d86f1f9-831b-4bf0-bc04-9961a1fb5a71 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:38.526094 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d86f1f9-831b-4bf0-bc04-9961a1fb5a71 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:38.526742 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d86f1f9-831b-4bf0-bc04-9961a1fb5a71 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:38.528929 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d86f1f9-831b-4bf0-bc04-9961a1fb5a71 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:38.529620 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d86f1f9-831b-4bf0-bc04-9961a1fb5a71 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:38.530053 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d86f1f9-831b-4bf0-bc04-9961a1fb5a71 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:38.649572 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f558d43b-111c-4534-8ce6-4486ace43e0d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:38.650996 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f558d43b-111c-4534-8ce6-4486ace43e0d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:38.660569 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f558d43b-111c-4534-8ce6-4486ace43e0d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:38.661802 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f558d43b-111c-4534-8ce6-4486ace43e0d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:38.662422 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f558d43b-111c-4534-8ce6-4486ace43e0d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:38.663342 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f558d43b-111c-4534-8ce6-4486ace43e0d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:38.664003 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f558d43b-111c-4534-8ce6-4486ace43e0d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:38.664611 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f558d43b-111c-4534-8ce6-4486ace43e0d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:38.726655 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1d86f1f9-831b-4bf0-bc04-9961a1fb5a71 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:38.739682 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1d86f1f9-831b-4bf0-bc04-9961a1fb5a71 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.245018 Aug 22 05:39:38.741692 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 113/233] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:38 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:38.900940 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-f558d43b-111c-4534-8ce6-4486ace43e0d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:38.915369 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f558d43b-111c-4534-8ce6-4486ace43e0d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1315 microversion: 2.1 time: 0.270052 Aug 22 05:39:38.917399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 121/234] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:38 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:39.090684 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7e0f4e63-4ea8-4909-a8e4-a9931d6e29d8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:39.091813 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7e0f4e63-4ea8-4909-a8e4-a9931d6e29d8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:39.102266 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e0f4e63-4ea8-4909-a8e4-a9931d6e29d8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:39.105481 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e0f4e63-4ea8-4909-a8e4-a9931d6e29d8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:39.106157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e0f4e63-4ea8-4909-a8e4-a9931d6e29d8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:39.107620 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e0f4e63-4ea8-4909-a8e4-a9931d6e29d8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:39.108175 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e0f4e63-4ea8-4909-a8e4-a9931d6e29d8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:39.110377 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e0f4e63-4ea8-4909-a8e4-a9931d6e29d8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:39.315337 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7e0f4e63-4ea8-4909-a8e4-a9931d6e29d8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:39.324248 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7e0f4e63-4ea8-4909-a8e4-a9931d6e29d8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.239823 Aug 22 05:39:39.338881 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 114/235] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:39 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:39.763360 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ee72dd10-6718-4ad0-9eea-46f86f7831d9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:39.764034 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ee72dd10-6718-4ad0-9eea-46f86f7831d9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:39.767450 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=76 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:39:39.776562 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ee72dd10-6718-4ad0-9eea-46f86f7831d9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:39.777327 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ee72dd10-6718-4ad0-9eea-46f86f7831d9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:39.778005 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ee72dd10-6718-4ad0-9eea-46f86f7831d9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:39.779186 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ee72dd10-6718-4ad0-9eea-46f86f7831d9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:39.779966 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ee72dd10-6718-4ad0-9eea-46f86f7831d9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:39.780403 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ee72dd10-6718-4ad0-9eea-46f86f7831d9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:39.940849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d5a60b39-b0b5-4ddd-bbd2-d1870dfdcedd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:39.941458 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d5a60b39-b0b5-4ddd-bbd2-d1870dfdcedd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:39.971967 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d5a60b39-b0b5-4ddd-bbd2-d1870dfdcedd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:39.971967 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d5a60b39-b0b5-4ddd-bbd2-d1870dfdcedd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:39.972997 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d5a60b39-b0b5-4ddd-bbd2-d1870dfdcedd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:39.973873 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d5a60b39-b0b5-4ddd-bbd2-d1870dfdcedd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:39.974321 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d5a60b39-b0b5-4ddd-bbd2-d1870dfdcedd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:39.976440 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d5a60b39-b0b5-4ddd-bbd2-d1870dfdcedd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:40.103608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ee72dd10-6718-4ad0-9eea-46f86f7831d9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:40.114393 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ee72dd10-6718-4ad0-9eea-46f86f7831d9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1361 microversion: 2.1 time: 0.354690 Aug 22 05:39:40.115449 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 122/236] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:39 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1361 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:40.295440 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d5a60b39-b0b5-4ddd-bbd2-d1870dfdcedd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:40.307900 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d5a60b39-b0b5-4ddd-bbd2-d1870dfdcedd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1501 microversion: 2.1 time: 0.370912 Aug 22 05:39:40.309970 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 115/237] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:39 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1501 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:40.349380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-772a4c26-052c-4bd6-9016-f38dee9c055b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:40.350273 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-772a4c26-052c-4bd6-9016-f38dee9c055b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:40.359122 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-772a4c26-052c-4bd6-9016-f38dee9c055b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:40.359870 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-772a4c26-052c-4bd6-9016-f38dee9c055b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:40.360688 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-772a4c26-052c-4bd6-9016-f38dee9c055b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:40.361971 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-772a4c26-052c-4bd6-9016-f38dee9c055b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:40.362747 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-772a4c26-052c-4bd6-9016-f38dee9c055b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:40.363480 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-772a4c26-052c-4bd6-9016-f38dee9c055b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:40.682665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-772a4c26-052c-4bd6-9016-f38dee9c055b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:40.695562 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-772a4c26-052c-4bd6-9016-f38dee9c055b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.353758 Aug 22 05:39:40.696771 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 123/238] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:40 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:41.135349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3051910b-bf6c-4e01-8a1c-e2d013fd3230 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:41.135928 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3051910b-bf6c-4e01-8a1c-e2d013fd3230 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:41.142567 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3051910b-bf6c-4e01-8a1c-e2d013fd3230 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:41.143042 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3051910b-bf6c-4e01-8a1c-e2d013fd3230 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:41.143863 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3051910b-bf6c-4e01-8a1c-e2d013fd3230 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:41.146811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3051910b-bf6c-4e01-8a1c-e2d013fd3230 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:41.148752 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3051910b-bf6c-4e01-8a1c-e2d013fd3230 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:41.150671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3051910b-bf6c-4e01-8a1c-e2d013fd3230 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:41.353994 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3051910b-bf6c-4e01-8a1c-e2d013fd3230 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:41.363794 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3051910b-bf6c-4e01-8a1c-e2d013fd3230 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1547 microversion: 2.1 time: 0.232213 Aug 22 05:39:41.372135 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 116/239] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:41 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1547 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:41.386003 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7d489e3e-2b73-4af9-bebd-668a90bcc31f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:41.387218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-7d489e3e-2b73-4af9-bebd-668a90bcc31f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:41.394637 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d489e3e-2b73-4af9-bebd-668a90bcc31f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:41.395449 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d489e3e-2b73-4af9-bebd-668a90bcc31f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:41.396155 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d489e3e-2b73-4af9-bebd-668a90bcc31f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:41.397401 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d489e3e-2b73-4af9-bebd-668a90bcc31f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:41.398093 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d489e3e-2b73-4af9-bebd-668a90bcc31f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:41.398800 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d489e3e-2b73-4af9-bebd-668a90bcc31f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:41.511801 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-7d489e3e-2b73-4af9-bebd-668a90bcc31f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129382 Aug 22 05:39:41.512423 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 124/240] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Aug 22 05:39:41 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:39:41.722971 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-34d23601-eadf-4c90-9cd0-437da41647ec tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:41.724253 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-34d23601-eadf-4c90-9cd0-437da41647ec tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:41.735627 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34d23601-eadf-4c90-9cd0-437da41647ec tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:41.736922 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34d23601-eadf-4c90-9cd0-437da41647ec tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:41.738521 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34d23601-eadf-4c90-9cd0-437da41647ec tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:41.740178 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34d23601-eadf-4c90-9cd0-437da41647ec tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:41.741557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34d23601-eadf-4c90-9cd0-437da41647ec tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:41.742936 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34d23601-eadf-4c90-9cd0-437da41647ec tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:41.970025 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-65f14aa7-75e2-4542-b7d1-750a33c9ff08 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31627591-0b85-4c46-bebb-a288a91bc5b6"}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:39:41.973251 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-65f14aa7-75e2-4542-b7d1-750a33c9ff08 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:41.988221 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-65f14aa7-75e2-4542-b7d1-750a33c9ff08 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:41.988545 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-65f14aa7-75e2-4542-b7d1-750a33c9ff08 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:41.990027 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-65f14aa7-75e2-4542-b7d1-750a33c9ff08 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:41.992433 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-65f14aa7-75e2-4542-b7d1-750a33c9ff08 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:41.992912 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-65f14aa7-75e2-4542-b7d1-750a33c9ff08 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:41.996116 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-65f14aa7-75e2-4542-b7d1-750a33c9ff08 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:42.073105 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-34d23601-eadf-4c90-9cd0-437da41647ec tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:42.084243 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-34d23601-eadf-4c90-9cd0-437da41647ec tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.368794 Aug 22 05:39:42.084837 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 117/241] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:41 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:43.106145 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ae0aee30-9d0b-4860-93f7-0a27105286d5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:43.106751 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ae0aee30-9d0b-4860-93f7-0a27105286d5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:43.112659 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae0aee30-9d0b-4860-93f7-0a27105286d5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:43.113376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae0aee30-9d0b-4860-93f7-0a27105286d5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:43.114112 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae0aee30-9d0b-4860-93f7-0a27105286d5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:43.115326 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae0aee30-9d0b-4860-93f7-0a27105286d5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:43.115798 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae0aee30-9d0b-4860-93f7-0a27105286d5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:43.116487 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae0aee30-9d0b-4860-93f7-0a27105286d5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:43.333411 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ae0aee30-9d0b-4860-93f7-0a27105286d5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:43.356525 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ae0aee30-9d0b-4860-93f7-0a27105286d5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.254185 Aug 22 05:39:43.369769 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 118/242] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:43 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:43.380991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-481d51ef-bb40-4eb6-a904-31b35166452d req-fade0b99-5b61-4687-9ba0-25dd3c62a4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "585fdc4d-a711-4748-9480-bb5a9bab88f4", "tag": "1b1f5f40-5b3a-4135-85ac-8b7ecf8f98f5"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:39:43.396927 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-481d51ef-bb40-4eb6-a904-31b35166452d req-fade0b99-5b61-4687-9ba0-25dd3c62a4d7 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:43.397480 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-481d51ef-bb40-4eb6-a904-31b35166452d req-fade0b99-5b61-4687-9ba0-25dd3c62a4d7 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:43.398004 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-481d51ef-bb40-4eb6-a904-31b35166452d req-fade0b99-5b61-4687-9ba0-25dd3c62a4d7 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:43.415149 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-481d51ef-bb40-4eb6-a904-31b35166452d req-fade0b99-5b61-4687-9ba0-25dd3c62a4d7 service nova] Creating event network-changed:1b1f5f40-5b3a-4135-85ac-8b7ecf8f98f5 for instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 on hv-cinder-85391 Aug 22 05:39:43.421313 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-481d51ef-bb40-4eb6-a904-31b35166452d req-fade0b99-5b61-4687-9ba0-25dd3c62a4d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044805 Aug 22 05:39:43.423013 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 119/243] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:39:44.387055 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e772fc53-2b41-4484-8f20-01db6799bed7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:44.387787 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e772fc53-2b41-4484-8f20-01db6799bed7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:44.395677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e772fc53-2b41-4484-8f20-01db6799bed7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:44.396681 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e772fc53-2b41-4484-8f20-01db6799bed7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:44.397125 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e772fc53-2b41-4484-8f20-01db6799bed7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:44.397838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e772fc53-2b41-4484-8f20-01db6799bed7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:44.398285 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e772fc53-2b41-4484-8f20-01db6799bed7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:44.398702 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e772fc53-2b41-4484-8f20-01db6799bed7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:44.590543 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e772fc53-2b41-4484-8f20-01db6799bed7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:44.599875 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e772fc53-2b41-4484-8f20-01db6799bed7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.220999 Aug 22 05:39:44.601011 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 120/244] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:44 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:45.621458 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f18e5fe7-34f9-4320-93a7-8eb1843c542c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:45.622204 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f18e5fe7-34f9-4320-93a7-8eb1843c542c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:45.630115 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f18e5fe7-34f9-4320-93a7-8eb1843c542c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:45.630603 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f18e5fe7-34f9-4320-93a7-8eb1843c542c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:45.631029 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f18e5fe7-34f9-4320-93a7-8eb1843c542c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:45.631951 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f18e5fe7-34f9-4320-93a7-8eb1843c542c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:45.632404 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f18e5fe7-34f9-4320-93a7-8eb1843c542c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:45.632822 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f18e5fe7-34f9-4320-93a7-8eb1843c542c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:45.657334 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-65f14aa7-75e2-4542-b7d1-750a33c9ff08 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "POST /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.692720 Aug 22 05:39:45.658408 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 125/245] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 22 05:39:41 2022] POST /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf/os-volume_attachments => generated 194 bytes in 3695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:39:45.793438 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f18e5fe7-34f9-4320-93a7-8eb1843c542c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:45.803898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f18e5fe7-34f9-4320-93a7-8eb1843c542c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.186469 Aug 22 05:39:45.804478 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 121/246] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:45 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:46.826086 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-fadbf69f-3355-4f61-9c10-fc100fadbf05 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:46.826816 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-fadbf69f-3355-4f61-9c10-fc100fadbf05 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:46.833418 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fadbf69f-3355-4f61-9c10-fc100fadbf05 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:46.833858 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fadbf69f-3355-4f61-9c10-fc100fadbf05 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:46.834513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fadbf69f-3355-4f61-9c10-fc100fadbf05 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:46.835203 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fadbf69f-3355-4f61-9c10-fc100fadbf05 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:46.835671 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fadbf69f-3355-4f61-9c10-fc100fadbf05 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:46.836080 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fadbf69f-3355-4f61-9c10-fc100fadbf05 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:46.976213 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-fadbf69f-3355-4f61-9c10-fc100fadbf05 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:46.984311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-fadbf69f-3355-4f61-9c10-fc100fadbf05 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.162970 Aug 22 05:39:46.984992 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 126/247] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:46 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:48.005265 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0b070c97-5d89-4cc8-9b49-6c1b08de80e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:48.005867 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0b070c97-5d89-4cc8-9b49-6c1b08de80e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:48.012288 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b070c97-5d89-4cc8-9b49-6c1b08de80e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:48.012952 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b070c97-5d89-4cc8-9b49-6c1b08de80e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:48.013383 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b070c97-5d89-4cc8-9b49-6c1b08de80e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:48.014088 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b070c97-5d89-4cc8-9b49-6c1b08de80e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:48.014534 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b070c97-5d89-4cc8-9b49-6c1b08de80e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:48.014990 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b070c97-5d89-4cc8-9b49-6c1b08de80e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:48.168044 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0b070c97-5d89-4cc8-9b49-6c1b08de80e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:48.177636 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0b070c97-5d89-4cc8-9b49-6c1b08de80e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.176446 Aug 22 05:39:48.178648 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 122/248] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:47 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:49.206107 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5a0e54af-60fc-4d9b-b4f3-ed212f434bea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:49.206912 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5a0e54af-60fc-4d9b-b4f3-ed212f434bea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:49.214509 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a0e54af-60fc-4d9b-b4f3-ed212f434bea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:49.214996 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a0e54af-60fc-4d9b-b4f3-ed212f434bea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:49.215428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a0e54af-60fc-4d9b-b4f3-ed212f434bea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:49.216160 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a0e54af-60fc-4d9b-b4f3-ed212f434bea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:49.216603 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a0e54af-60fc-4d9b-b4f3-ed212f434bea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:49.217058 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a0e54af-60fc-4d9b-b4f3-ed212f434bea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:49.354817 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5a0e54af-60fc-4d9b-b4f3-ed212f434bea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:49.362717 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5a0e54af-60fc-4d9b-b4f3-ed212f434bea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.162098 Aug 22 05:39:49.363271 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 127/249] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:49 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:50.386225 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ef2fa284-b87d-4ecf-95ea-d9047b768ad5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:50.386830 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ef2fa284-b87d-4ecf-95ea-d9047b768ad5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:50.388924 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=68 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:39:50.396336 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ef2fa284-b87d-4ecf-95ea-d9047b768ad5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:50.397286 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ef2fa284-b87d-4ecf-95ea-d9047b768ad5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:50.397913 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ef2fa284-b87d-4ecf-95ea-d9047b768ad5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:50.398942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ef2fa284-b87d-4ecf-95ea-d9047b768ad5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:50.399583 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ef2fa284-b87d-4ecf-95ea-d9047b768ad5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:50.400199 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ef2fa284-b87d-4ecf-95ea-d9047b768ad5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:50.553681 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ef2fa284-b87d-4ecf-95ea-d9047b768ad5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:50.561616 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ef2fa284-b87d-4ecf-95ea-d9047b768ad5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.179451 Aug 22 05:39:50.562178 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 123/250] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:50 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:51.584617 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-82fcd8fc-7ea3-4c62-bd5b-f24fefee6a6f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:51.586157 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-82fcd8fc-7ea3-4c62-bd5b-f24fefee6a6f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:51.593304 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82fcd8fc-7ea3-4c62-bd5b-f24fefee6a6f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:51.593822 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82fcd8fc-7ea3-4c62-bd5b-f24fefee6a6f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:51.594490 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82fcd8fc-7ea3-4c62-bd5b-f24fefee6a6f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:51.595186 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82fcd8fc-7ea3-4c62-bd5b-f24fefee6a6f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:51.595685 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82fcd8fc-7ea3-4c62-bd5b-f24fefee6a6f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:51.596263 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82fcd8fc-7ea3-4c62-bd5b-f24fefee6a6f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:51.623686 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:39:51.738375 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-82fcd8fc-7ea3-4c62-bd5b-f24fefee6a6f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:51.747349 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-82fcd8fc-7ea3-4c62-bd5b-f24fefee6a6f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.166580 Aug 22 05:39:51.747966 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 128/251] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:51 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:52.772153 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-57797f8f-f1ea-4b97-ac56-c16f12cea27a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:52.773408 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-57797f8f-f1ea-4b97-ac56-c16f12cea27a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:52.783377 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57797f8f-f1ea-4b97-ac56-c16f12cea27a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:52.784236 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57797f8f-f1ea-4b97-ac56-c16f12cea27a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:52.784954 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57797f8f-f1ea-4b97-ac56-c16f12cea27a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:52.786089 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57797f8f-f1ea-4b97-ac56-c16f12cea27a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:52.786841 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57797f8f-f1ea-4b97-ac56-c16f12cea27a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:52.787544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57797f8f-f1ea-4b97-ac56-c16f12cea27a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:52.942070 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-57797f8f-f1ea-4b97-ac56-c16f12cea27a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:52.949852 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-57797f8f-f1ea-4b97-ac56-c16f12cea27a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.184349 Aug 22 05:39:52.950416 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 124/252] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:52 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:53.974384 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-620716b4-3db9-4966-9c55-714d55ea2599 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:53.975505 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-620716b4-3db9-4966-9c55-714d55ea2599 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:53.989497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-620716b4-3db9-4966-9c55-714d55ea2599 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:53.989986 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-620716b4-3db9-4966-9c55-714d55ea2599 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:53.990415 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-620716b4-3db9-4966-9c55-714d55ea2599 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:53.991279 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-620716b4-3db9-4966-9c55-714d55ea2599 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:53.991830 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-620716b4-3db9-4966-9c55-714d55ea2599 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:53.992387 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-620716b4-3db9-4966-9c55-714d55ea2599 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:54.222434 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-620716b4-3db9-4966-9c55-714d55ea2599 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:54.236268 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-620716b4-3db9-4966-9c55-714d55ea2599 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.269135 Aug 22 05:39:54.237411 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 129/253] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:53 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:55.258702 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-22895eda-2993-4200-bbe1-3160c597a885 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:55.260209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-22895eda-2993-4200-bbe1-3160c597a885 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:55.268394 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22895eda-2993-4200-bbe1-3160c597a885 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:55.268873 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22895eda-2993-4200-bbe1-3160c597a885 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:55.269298 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22895eda-2993-4200-bbe1-3160c597a885 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:55.270751 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22895eda-2993-4200-bbe1-3160c597a885 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:55.271362 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22895eda-2993-4200-bbe1-3160c597a885 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:55.271952 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22895eda-2993-4200-bbe1-3160c597a885 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:55.473678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-22895eda-2993-4200-bbe1-3160c597a885 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:55.483284 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-22895eda-2993-4200-bbe1-3160c597a885 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.229364 Aug 22 05:39:55.490182 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 125/254] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:55 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:56.504534 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-77a46775-2f9b-4d86-b029-f902b868e325 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:56.505323 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-77a46775-2f9b-4d86-b029-f902b868e325 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:56.512150 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-77a46775-2f9b-4d86-b029-f902b868e325 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:56.512955 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-77a46775-2f9b-4d86-b029-f902b868e325 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:56.513485 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-77a46775-2f9b-4d86-b029-f902b868e325 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:56.514269 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-77a46775-2f9b-4d86-b029-f902b868e325 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:56.514920 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-77a46775-2f9b-4d86-b029-f902b868e325 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:56.515564 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-77a46775-2f9b-4d86-b029-f902b868e325 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:56.666975 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-77a46775-2f9b-4d86-b029-f902b868e325 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:56.677026 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-77a46775-2f9b-4d86-b029-f902b868e325 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.176526 Aug 22 05:39:56.677612 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 130/255] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:56 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:57.697699 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e8f47883-9cb8-496b-8367-f3e25390d1df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:57.698259 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e8f47883-9cb8-496b-8367-f3e25390d1df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:57.704378 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e8f47883-9cb8-496b-8367-f3e25390d1df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:57.704818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e8f47883-9cb8-496b-8367-f3e25390d1df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:57.705264 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e8f47883-9cb8-496b-8367-f3e25390d1df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:57.705936 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e8f47883-9cb8-496b-8367-f3e25390d1df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:57.706372 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e8f47883-9cb8-496b-8367-f3e25390d1df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:57.706779 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e8f47883-9cb8-496b-8367-f3e25390d1df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:57.710775 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:39:57.861652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e8f47883-9cb8-496b-8367-f3e25390d1df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:57.872483 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e8f47883-9cb8-496b-8367-f3e25390d1df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.178740 Aug 22 05:39:57.873297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 126/256] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:57 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:39:58.901432 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-90ca0457-a39a-43e2-9f4d-da582c1b8df0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:39:58.901432 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-90ca0457-a39a-43e2-9f4d-da582c1b8df0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:39:58.904134 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-90ca0457-a39a-43e2-9f4d-da582c1b8df0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:58.904134 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-90ca0457-a39a-43e2-9f4d-da582c1b8df0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:58.904134 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-90ca0457-a39a-43e2-9f4d-da582c1b8df0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:58.904134 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-90ca0457-a39a-43e2-9f4d-da582c1b8df0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:39:58.904413 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-90ca0457-a39a-43e2-9f4d-da582c1b8df0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:39:58.904850 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-90ca0457-a39a-43e2-9f4d-da582c1b8df0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:39:59.046070 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-90ca0457-a39a-43e2-9f4d-da582c1b8df0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:39:59.054087 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-90ca0457-a39a-43e2-9f4d-da582c1b8df0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.163525 Aug 22 05:39:59.054931 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 131/257] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:39:58 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:00.075067 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-19c0b3d9-c9bd-4bfc-89b5-1be6ee27a08b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:00.075705 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-19c0b3d9-c9bd-4bfc-89b5-1be6ee27a08b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:00.083670 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19c0b3d9-c9bd-4bfc-89b5-1be6ee27a08b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:00.083670 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19c0b3d9-c9bd-4bfc-89b5-1be6ee27a08b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:00.083670 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19c0b3d9-c9bd-4bfc-89b5-1be6ee27a08b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:00.083670 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19c0b3d9-c9bd-4bfc-89b5-1be6ee27a08b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:00.083995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19c0b3d9-c9bd-4bfc-89b5-1be6ee27a08b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:00.084227 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19c0b3d9-c9bd-4bfc-89b5-1be6ee27a08b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:00.224716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-19c0b3d9-c9bd-4bfc-89b5-1be6ee27a08b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:00.233329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-19c0b3d9-c9bd-4bfc-89b5-1be6ee27a08b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.162470 Aug 22 05:40:00.239439 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 127/258] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:00 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:01.255095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5a65b54b-ada1-4395-b8c5-ecaa333f98bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:01.255905 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5a65b54b-ada1-4395-b8c5-ecaa333f98bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:01.264458 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a65b54b-ada1-4395-b8c5-ecaa333f98bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:01.264938 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a65b54b-ada1-4395-b8c5-ecaa333f98bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:01.265385 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a65b54b-ada1-4395-b8c5-ecaa333f98bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:01.266059 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a65b54b-ada1-4395-b8c5-ecaa333f98bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:01.266502 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a65b54b-ada1-4395-b8c5-ecaa333f98bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:01.266915 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a65b54b-ada1-4395-b8c5-ecaa333f98bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:01.407141 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5a65b54b-ada1-4395-b8c5-ecaa333f98bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:01.414872 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5a65b54b-ada1-4395-b8c5-ecaa333f98bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.164020 Aug 22 05:40:01.415432 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 132/259] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:01 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:02.438479 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-16f1450d-1365-4447-aef0-a59890d375e4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:02.439155 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-16f1450d-1365-4447-aef0-a59890d375e4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:02.448508 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-16f1450d-1365-4447-aef0-a59890d375e4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:02.448984 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-16f1450d-1365-4447-aef0-a59890d375e4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:02.449415 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-16f1450d-1365-4447-aef0-a59890d375e4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:02.450093 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-16f1450d-1365-4447-aef0-a59890d375e4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:02.450539 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-16f1450d-1365-4447-aef0-a59890d375e4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:02.450974 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-16f1450d-1365-4447-aef0-a59890d375e4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:02.597143 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-16f1450d-1365-4447-aef0-a59890d375e4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:02.605891 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-16f1450d-1365-4447-aef0-a59890d375e4 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.173446 Aug 22 05:40:02.606483 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 128/260] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:02 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:02.867452 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-aabba05a-6d2b-4d65-8b93-21f4809446dd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:02.867987 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-aabba05a-6d2b-4d65-8b93-21f4809446dd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:02.875044 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aabba05a-6d2b-4d65-8b93-21f4809446dd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:02.875567 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aabba05a-6d2b-4d65-8b93-21f4809446dd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:02.876028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aabba05a-6d2b-4d65-8b93-21f4809446dd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:02.876763 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aabba05a-6d2b-4d65-8b93-21f4809446dd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:02.877216 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aabba05a-6d2b-4d65-8b93-21f4809446dd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:02.877663 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aabba05a-6d2b-4d65-8b93-21f4809446dd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:02.905446 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-aabba05a-6d2b-4d65-8b93-21f4809446dd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Going to try to terminate instance {{(pid=132497) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:40:03.011035 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-aabba05a-6d2b-4d65-8b93-21f4809446dd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "DELETE /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 204 len: 0 microversion: 2.1 time: 0.147009 Aug 22 05:40:03.012317 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 133/261] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:40:02 2022] DELETE /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:40:03.025493 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0a0f3cb3-c6e6-4ad4-a2eb-70aaed0bf28b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:03.026211 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0a0f3cb3-c6e6-4ad4-a2eb-70aaed0bf28b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:03.037978 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a0f3cb3-c6e6-4ad4-a2eb-70aaed0bf28b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:03.038462 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a0f3cb3-c6e6-4ad4-a2eb-70aaed0bf28b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:03.038887 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a0f3cb3-c6e6-4ad4-a2eb-70aaed0bf28b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:03.039620 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a0f3cb3-c6e6-4ad4-a2eb-70aaed0bf28b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:03.040041 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a0f3cb3-c6e6-4ad4-a2eb-70aaed0bf28b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:03.040450 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a0f3cb3-c6e6-4ad4-a2eb-70aaed0bf28b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:03.198580 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0a0f3cb3-c6e6-4ad4-a2eb-70aaed0bf28b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:03.207847 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0a0f3cb3-c6e6-4ad4-a2eb-70aaed0bf28b tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1553 microversion: 2.1 time: 0.190147 Aug 22 05:40:03.208660 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 129/262] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:03 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:40:03.628317 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5f4adff2-2fc9-41c3-9370-dea11c7193b3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:03.628317 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5f4adff2-2fc9-41c3-9370-dea11c7193b3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:03.633916 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f4adff2-2fc9-41c3-9370-dea11c7193b3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:03.634417 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f4adff2-2fc9-41c3-9370-dea11c7193b3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:03.634830 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f4adff2-2fc9-41c3-9370-dea11c7193b3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:03.635812 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f4adff2-2fc9-41c3-9370-dea11c7193b3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:03.636634 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f4adff2-2fc9-41c3-9370-dea11c7193b3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:03.637055 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f4adff2-2fc9-41c3-9370-dea11c7193b3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:03.791640 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5f4adff2-2fc9-41c3-9370-dea11c7193b3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:03.801472 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5f4adff2-2fc9-41c3-9370-dea11c7193b3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.178192 Aug 22 05:40:03.802066 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 134/263] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:03 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:04.236547 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9f93d139-0b16-44e8-84cb-64fa38f6ae4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:04.237719 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9f93d139-0b16-44e8-84cb-64fa38f6ae4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:04.244319 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9f93d139-0b16-44e8-84cb-64fa38f6ae4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:04.245424 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9f93d139-0b16-44e8-84cb-64fa38f6ae4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:04.246048 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9f93d139-0b16-44e8-84cb-64fa38f6ae4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:04.246927 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9f93d139-0b16-44e8-84cb-64fa38f6ae4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:04.247527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9f93d139-0b16-44e8-84cb-64fa38f6ae4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:04.248134 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9f93d139-0b16-44e8-84cb-64fa38f6ae4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:04.453091 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9f93d139-0b16-44e8-84cb-64fa38f6ae4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:04.463226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9f93d139-0b16-44e8-84cb-64fa38f6ae4d tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1553 microversion: 2.1 time: 0.230262 Aug 22 05:40:04.464245 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 130/264] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:04 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:04.824869 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5f5155e0-6d96-4303-a6e8-5677c08307e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:04.825838 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5f5155e0-6d96-4303-a6e8-5677c08307e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:04.837887 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f5155e0-6d96-4303-a6e8-5677c08307e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:04.838789 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f5155e0-6d96-4303-a6e8-5677c08307e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:04.839470 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f5155e0-6d96-4303-a6e8-5677c08307e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:04.840434 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f5155e0-6d96-4303-a6e8-5677c08307e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:04.841381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f5155e0-6d96-4303-a6e8-5677c08307e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:04.842039 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f5155e0-6d96-4303-a6e8-5677c08307e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:04.987992 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5f5155e0-6d96-4303-a6e8-5677c08307e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:04.999173 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5f5155e0-6d96-4303-a6e8-5677c08307e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.179084 Aug 22 05:40:04.999971 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 135/265] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:04 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:05.500361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b7a0fc08-5a60-4adc-bcc3-257dc5d7fc06 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:05.503093 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b7a0fc08-5a60-4adc-bcc3-257dc5d7fc06 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:05.529650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b7a0fc08-5a60-4adc-bcc3-257dc5d7fc06 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:05.530157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b7a0fc08-5a60-4adc-bcc3-257dc5d7fc06 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:05.530597 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b7a0fc08-5a60-4adc-bcc3-257dc5d7fc06 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:05.535058 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b7a0fc08-5a60-4adc-bcc3-257dc5d7fc06 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:05.535539 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b7a0fc08-5a60-4adc-bcc3-257dc5d7fc06 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:05.536053 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b7a0fc08-5a60-4adc-bcc3-257dc5d7fc06 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:05.765884 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b7a0fc08-5a60-4adc-bcc3-257dc5d7fc06 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:05.781626 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b7a0fc08-5a60-4adc-bcc3-257dc5d7fc06 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1553 microversion: 2.1 time: 0.298862 Aug 22 05:40:05.782732 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 131/266] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:05 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1553 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:06.020524 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-cce2b1cf-f385-4bf3-b2de-b0622876a3a3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:06.021989 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-cce2b1cf-f385-4bf3-b2de-b0622876a3a3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:06.029292 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cce2b1cf-f385-4bf3-b2de-b0622876a3a3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:06.029967 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cce2b1cf-f385-4bf3-b2de-b0622876a3a3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:06.030499 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cce2b1cf-f385-4bf3-b2de-b0622876a3a3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:06.031595 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cce2b1cf-f385-4bf3-b2de-b0622876a3a3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:06.032260 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cce2b1cf-f385-4bf3-b2de-b0622876a3a3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:06.033560 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cce2b1cf-f385-4bf3-b2de-b0622876a3a3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:06.271148 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-4fc6f58a-9b5b-4754-966d-d36974d48c08 req-73254b3e-ea6b-4ce3-b88d-d5e90f673fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09fac986-176b-43b6-a4c4-c32b1513a3bf", "name": "network-vif-deleted", "tag": "11155cdc-4e7d-4c79-b482-df219fb67393"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:40:06.284013 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-4fc6f58a-9b5b-4754-966d-d36974d48c08 req-73254b3e-ea6b-4ce3-b88d-d5e90f673fac service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:06.284748 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-4fc6f58a-9b5b-4754-966d-d36974d48c08 req-73254b3e-ea6b-4ce3-b88d-d5e90f673fac service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:06.285742 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-4fc6f58a-9b5b-4754-966d-d36974d48c08 req-73254b3e-ea6b-4ce3-b88d-d5e90f673fac service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:06.298552 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-4fc6f58a-9b5b-4754-966d-d36974d48c08 req-73254b3e-ea6b-4ce3-b88d-d5e90f673fac service nova] Creating event network-vif-deleted:11155cdc-4e7d-4c79-b482-df219fb67393 for instance 09fac986-176b-43b6-a4c4-c32b1513a3bf on hv-cinder-85391 Aug 22 05:40:06.304091 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-4fc6f58a-9b5b-4754-966d-d36974d48c08 req-73254b3e-ea6b-4ce3-b88d-d5e90f673fac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036789 Aug 22 05:40:06.307966 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 132/267] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:40:06.314306 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-cce2b1cf-f385-4bf3-b2de-b0622876a3a3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:06.322411 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-cce2b1cf-f385-4bf3-b2de-b0622876a3a3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.305619 Aug 22 05:40:06.335999 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 136/268] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:06 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:06.812812 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e40bd785-dac3-49eb-b86e-bf63f1ce2e18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:06.815199 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e40bd785-dac3-49eb-b86e-bf63f1ce2e18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:06.825626 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e40bd785-dac3-49eb-b86e-bf63f1ce2e18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:06.826316 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e40bd785-dac3-49eb-b86e-bf63f1ce2e18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:06.826967 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e40bd785-dac3-49eb-b86e-bf63f1ce2e18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:06.827972 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e40bd785-dac3-49eb-b86e-bf63f1ce2e18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:06.828667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e40bd785-dac3-49eb-b86e-bf63f1ce2e18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:06.829386 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e40bd785-dac3-49eb-b86e-bf63f1ce2e18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:06.927883 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e40bd785-dac3-49eb-b86e-bf63f1ce2e18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:06.947349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e40bd785-dac3-49eb-b86e-bf63f1ce2e18 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1346 microversion: 2.1 time: 0.140013 Aug 22 05:40:06.948056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 133/269] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:06 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1346 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:07.352483 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0479bd97-a58f-41cb-aa9a-365034562c61 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:07.357481 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0479bd97-a58f-41cb-aa9a-365034562c61 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:07.370489 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0479bd97-a58f-41cb-aa9a-365034562c61 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:07.371139 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0479bd97-a58f-41cb-aa9a-365034562c61 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:07.371775 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0479bd97-a58f-41cb-aa9a-365034562c61 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:07.372708 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0479bd97-a58f-41cb-aa9a-365034562c61 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:07.373098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0479bd97-a58f-41cb-aa9a-365034562c61 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:07.373842 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0479bd97-a58f-41cb-aa9a-365034562c61 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:07.524103 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0479bd97-a58f-41cb-aa9a-365034562c61 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:07.532331 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0479bd97-a58f-41cb-aa9a-365034562c61 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.183530 Aug 22 05:40:07.533195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 137/270] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:07 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:07.971041 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-54593470-1e57-4d36-8e52-10a5263cbee5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:07.972137 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-54593470-1e57-4d36-8e52-10a5263cbee5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:07.979245 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54593470-1e57-4d36-8e52-10a5263cbee5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:07.980291 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54593470-1e57-4d36-8e52-10a5263cbee5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:07.981155 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54593470-1e57-4d36-8e52-10a5263cbee5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:07.982518 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54593470-1e57-4d36-8e52-10a5263cbee5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:07.983049 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54593470-1e57-4d36-8e52-10a5263cbee5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:07.984217 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54593470-1e57-4d36-8e52-10a5263cbee5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:08.053187 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-54593470-1e57-4d36-8e52-10a5263cbee5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:08.061471 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-54593470-1e57-4d36-8e52-10a5263cbee5 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1346 microversion: 2.1 time: 0.096016 Aug 22 05:40:08.062047 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 134/271] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:07 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:08.553899 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-32faca51-0015-4321-9664-014549eb833a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:08.555106 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-32faca51-0015-4321-9664-014549eb833a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:08.562396 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32faca51-0015-4321-9664-014549eb833a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:08.562868 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32faca51-0015-4321-9664-014549eb833a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:08.563460 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32faca51-0015-4321-9664-014549eb833a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:08.564332 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32faca51-0015-4321-9664-014549eb833a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:08.564850 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32faca51-0015-4321-9664-014549eb833a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:08.565168 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32faca51-0015-4321-9664-014549eb833a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:08.739682 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-32faca51-0015-4321-9664-014549eb833a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:08.747732 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-32faca51-0015-4321-9664-014549eb833a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.197465 Aug 22 05:40:08.748487 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 138/272] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:08 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:09.082338 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3d30cfa6-c855-4914-af22-117bfaf80509 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:09.083013 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3d30cfa6-c855-4914-af22-117bfaf80509 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:09.088973 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3d30cfa6-c855-4914-af22-117bfaf80509 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:09.089659 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3d30cfa6-c855-4914-af22-117bfaf80509 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:09.090094 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3d30cfa6-c855-4914-af22-117bfaf80509 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:09.090785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3d30cfa6-c855-4914-af22-117bfaf80509 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:09.091230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3d30cfa6-c855-4914-af22-117bfaf80509 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:09.091668 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3d30cfa6-c855-4914-af22-117bfaf80509 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:09.160258 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3d30cfa6-c855-4914-af22-117bfaf80509 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:09.172904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3d30cfa6-c855-4914-af22-117bfaf80509 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1346 microversion: 2.1 time: 0.094169 Aug 22 05:40:09.173829 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 135/273] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:09 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:09.769354 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-2f9a0898-ec53-4212-9522-19fa7cbb48bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:09.769993 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-2f9a0898-ec53-4212-9522-19fa7cbb48bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:09.773551 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:40:09.778390 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f9a0898-ec53-4212-9522-19fa7cbb48bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:09.778960 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f9a0898-ec53-4212-9522-19fa7cbb48bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:09.779404 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f9a0898-ec53-4212-9522-19fa7cbb48bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:09.780260 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f9a0898-ec53-4212-9522-19fa7cbb48bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:09.780710 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f9a0898-ec53-4212-9522-19fa7cbb48bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:09.781161 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f9a0898-ec53-4212-9522-19fa7cbb48bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:10.153386 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-2f9a0898-ec53-4212-9522-19fa7cbb48bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:10.161193 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-2f9a0898-ec53-4212-9522-19fa7cbb48bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.395934 Aug 22 05:40:10.161768 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 139/274] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:09 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:10.195106 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-83194b09-e78c-4edb-9382-f00a81c07957 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:10.195716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-83194b09-e78c-4edb-9382-f00a81c07957 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:10.202382 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83194b09-e78c-4edb-9382-f00a81c07957 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:10.202866 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83194b09-e78c-4edb-9382-f00a81c07957 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:10.203295 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83194b09-e78c-4edb-9382-f00a81c07957 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:10.204033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83194b09-e78c-4edb-9382-f00a81c07957 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:10.204476 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83194b09-e78c-4edb-9382-f00a81c07957 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:10.204926 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83194b09-e78c-4edb-9382-f00a81c07957 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:10.272791 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-83194b09-e78c-4edb-9382-f00a81c07957 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:10.281625 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-83194b09-e78c-4edb-9382-f00a81c07957 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1346 microversion: 2.1 time: 0.090446 Aug 22 05:40:10.282195 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 136/275] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:10 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:11.182156 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ceacc3f5-c106-4a08-a67c-14033c6300c3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:11.182885 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ceacc3f5-c106-4a08-a67c-14033c6300c3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:11.189484 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ceacc3f5-c106-4a08-a67c-14033c6300c3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:11.189959 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ceacc3f5-c106-4a08-a67c-14033c6300c3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:11.190384 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ceacc3f5-c106-4a08-a67c-14033c6300c3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:11.191058 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ceacc3f5-c106-4a08-a67c-14033c6300c3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:11.191497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ceacc3f5-c106-4a08-a67c-14033c6300c3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:11.191940 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ceacc3f5-c106-4a08-a67c-14033c6300c3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:11.302272 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a69691a0-5432-4b20-8805-ca57137af898 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:11.302891 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a69691a0-5432-4b20-8805-ca57137af898 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:11.309498 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a69691a0-5432-4b20-8805-ca57137af898 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:11.309986 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a69691a0-5432-4b20-8805-ca57137af898 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:11.310416 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a69691a0-5432-4b20-8805-ca57137af898 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:11.311112 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a69691a0-5432-4b20-8805-ca57137af898 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:11.311560 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a69691a0-5432-4b20-8805-ca57137af898 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:11.312002 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a69691a0-5432-4b20-8805-ca57137af898 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:11.323075 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ceacc3f5-c106-4a08-a67c-14033c6300c3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:11.331482 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ceacc3f5-c106-4a08-a67c-14033c6300c3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.153131 Aug 22 05:40:11.332045 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 140/276] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:11 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:11.376236 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a69691a0-5432-4b20-8805-ca57137af898 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904630cc2e60419d88afd9cfc1c5914d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822f0c2e66354549aeb13d73c512b09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:11.388168 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a69691a0-5432-4b20-8805-ca57137af898 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 200 len: 1346 microversion: 2.1 time: 0.089730 Aug 22 05:40:11.388927 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 137/277] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:11 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 1346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:12.353111 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a06f2d90-d9f7-4f87-81bc-19c7b2dc34ba tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:12.353714 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a06f2d90-d9f7-4f87-81bc-19c7b2dc34ba tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:12.360807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a06f2d90-d9f7-4f87-81bc-19c7b2dc34ba tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:12.361349 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a06f2d90-d9f7-4f87-81bc-19c7b2dc34ba tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:12.362018 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a06f2d90-d9f7-4f87-81bc-19c7b2dc34ba tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:12.362833 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a06f2d90-d9f7-4f87-81bc-19c7b2dc34ba tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:12.363341 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a06f2d90-d9f7-4f87-81bc-19c7b2dc34ba tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:12.364043 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a06f2d90-d9f7-4f87-81bc-19c7b2dc34ba tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:12.410604 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c9408b16-a965-44ed-aa1a-33aec766c515 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:12.411829 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c9408b16-a965-44ed-aa1a-33aec766c515 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:12.418651 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9408b16-a965-44ed-aa1a-33aec766c515 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:12.419166 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9408b16-a965-44ed-aa1a-33aec766c515 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:12.419670 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9408b16-a965-44ed-aa1a-33aec766c515 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:12.420410 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9408b16-a965-44ed-aa1a-33aec766c515 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:12.420843 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9408b16-a965-44ed-aa1a-33aec766c515 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:12.421264 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9408b16-a965-44ed-aa1a-33aec766c515 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:12.436149 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-c9408b16-a965-44ed-aa1a-33aec766c515 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] HTTP exception thrown: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c9408b16-a965-44ed-aa1a-33aec766c515 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Request method failure captured: Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf HTTP/1.1 Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxZKmKd-7tqKoNEa1iyqI9AYypIoCfe-QCSRP2i_poljuyx1q498ZIzmf51QF0Uy6pmfoj5b6Vvdul3mUgu3ogJAio2ouioogt2lbZP65x33kSmJNI8AitUTlAmoOIOrXwLflYZ-shM2ZvB2Q68MR-bXOuTiOydjjYCi1ySHLbnPVZw Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 822f0c2e66354549aeb13d73c512b09d Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-DeleteServersTestJSON-700033058 Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:40:12.440912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:40:12.442392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_822f0c2e66354549aeb13d73c512b09d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/822f0c2e66354549aeb13d73c512b09d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/822f0c2e66354549aeb13d73c512b09d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/822f0c2e66354549aeb13d73c512b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:40:12.442392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-DeleteServersTestJSON-700033058 Aug 22 05:40:12.442392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 822f0c2e66354549aeb13d73c512b09d Aug 22 05:40:12.442392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-DeleteServersTestJSON-700033058 Aug 22 05:40:12.442392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-DeleteServersTestJSON-700033058-project Aug 22 05:40:12.442392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:40:12.442392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:40:12.442392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 904630cc2e60419d88afd9cfc1c5914d Aug 22 05:40:12.442392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-DeleteServersTestJSON-700033058-project Aug 22 05:40:12.442392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:40:12.442392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:12.442392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '09fac986-176b-43b6-a4c4-c32b1513a3bf'} Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:40:12.443136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:12.444526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:40:12.445774 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c9408b16-a965-44ed-aa1a-33aec766c515 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Returning 404 to user: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:40:12.445774 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c9408b16-a965-44ed-aa1a-33aec766c515 tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 404 len: 111 microversion: 2.1 time: 0.036074 Aug 22 05:40:12.445774 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 138/278] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:12 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:40:12.530523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a06f2d90-d9f7-4f87-81bc-19c7b2dc34ba tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:12.542585 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a06f2d90-d9f7-4f87-81bc-19c7b2dc34ba tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.193294 Aug 22 05:40:12.543473 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 141/279] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:12 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:12.587326 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-74337525-c145-4011-8a96-8ecfa63700cd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:12.590072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-74337525-c145-4011-8a96-8ecfa63700cd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:12.597545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74337525-c145-4011-8a96-8ecfa63700cd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:12.598483 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74337525-c145-4011-8a96-8ecfa63700cd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:12.599118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74337525-c145-4011-8a96-8ecfa63700cd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:12.600108 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74337525-c145-4011-8a96-8ecfa63700cd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:12.600982 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74337525-c145-4011-8a96-8ecfa63700cd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:12.601646 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74337525-c145-4011-8a96-8ecfa63700cd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:12.649773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-74337525-c145-4011-8a96-8ecfa63700cd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] HTTP exception thrown: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-74337525-c145-4011-8a96-8ecfa63700cd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Request method failure captured: Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf/os-volume_attachments HTTP/1.1 Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxZKmKd-7tqKoNEa1iyqI9AYypIoCfe-QCSRP2i_poljuyx1q498ZIzmf51QF0Uy6pmfoj5b6Vvdul3mUgu3ogJAio2ouioogt2lbZP65x33kSmJNI8AitUTlAmoOIOrXwLflYZ-shM2ZvB2Q68MR-bXOuTiOydjjYCi1ySHLbnPVZw Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 822f0c2e66354549aeb13d73c512b09d Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-DeleteServersTestJSON-700033058 Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:40:12.651678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:40:12.653099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_822f0c2e66354549aeb13d73c512b09d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/822f0c2e66354549aeb13d73c512b09d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/822f0c2e66354549aeb13d73c512b09d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/822f0c2e66354549aeb13d73c512b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:40:12.653099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-DeleteServersTestJSON-700033058 Aug 22 05:40:12.653099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 822f0c2e66354549aeb13d73c512b09d Aug 22 05:40:12.653099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-DeleteServersTestJSON-700033058 Aug 22 05:40:12.653099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-DeleteServersTestJSON-700033058-project Aug 22 05:40:12.653099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:40:12.653099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:40:12.653099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 904630cc2e60419d88afd9cfc1c5914d Aug 22 05:40:12.653099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-DeleteServersTestJSON-700033058-project Aug 22 05:40:12.653099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:40:12.653099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:12.653099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'server_id': '09fac986-176b-43b6-a4c4-c32b1513a3bf'} Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:40:12.657196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:12.658507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:40:12.659874 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-74337525-c145-4011-8a96-8ecfa63700cd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Returning 404 to user: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:40:12.659874 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-74337525-c145-4011-8a96-8ecfa63700cd tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.069843 Aug 22 05:40:12.659874 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 139/280] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 22 05:40:12 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf/os-volume_attachments => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:40:13.564324 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-18efc892-03fb-4a14-8992-99703eb7259b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:13.564920 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-18efc892-03fb-4a14-8992-99703eb7259b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:13.571789 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-18efc892-03fb-4a14-8992-99703eb7259b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:13.572245 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-18efc892-03fb-4a14-8992-99703eb7259b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:13.572676 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-18efc892-03fb-4a14-8992-99703eb7259b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:13.573353 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-18efc892-03fb-4a14-8992-99703eb7259b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:13.573790 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-18efc892-03fb-4a14-8992-99703eb7259b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:13.574222 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-18efc892-03fb-4a14-8992-99703eb7259b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:13.727467 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-18efc892-03fb-4a14-8992-99703eb7259b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:13.735914 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-18efc892-03fb-4a14-8992-99703eb7259b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.176193 Aug 22 05:40:13.736487 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 142/281] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:13 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:13.878469 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-31e8eec7-04eb-4df0-af6d-eedc04b11cbe tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:13.879009 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-31e8eec7-04eb-4df0-af6d-eedc04b11cbe tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:13.885510 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-31e8eec7-04eb-4df0-af6d-eedc04b11cbe tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:13.885994 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-31e8eec7-04eb-4df0-af6d-eedc04b11cbe tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:13.886429 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-31e8eec7-04eb-4df0-af6d-eedc04b11cbe tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:13.887146 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-31e8eec7-04eb-4df0-af6d-eedc04b11cbe tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:13.887613 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-31e8eec7-04eb-4df0-af6d-eedc04b11cbe tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:13.888243 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-31e8eec7-04eb-4df0-af6d-eedc04b11cbe tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:13.902582 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-31e8eec7-04eb-4df0-af6d-eedc04b11cbe tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] HTTP exception thrown: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-31e8eec7-04eb-4df0-af6d-eedc04b11cbe tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Request method failure captured: Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: DELETE /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf HTTP/1.1 Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxZKmKd-7tqKoNEa1iyqI9AYypIoCfe-QCSRP2i_poljuyx1q498ZIzmf51QF0Uy6pmfoj5b6Vvdul3mUgu3ogJAio2ouioogt2lbZP65x33kSmJNI8AitUTlAmoOIOrXwLflYZ-shM2ZvB2Q68MR-bXOuTiOydjjYCi1ySHLbnPVZw Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 822f0c2e66354549aeb13d73c512b09d Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-DeleteServersTestJSON-700033058 Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:40:13.904308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:40:13.905731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_822f0c2e66354549aeb13d73c512b09d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/822f0c2e66354549aeb13d73c512b09d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/822f0c2e66354549aeb13d73c512b09d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/822f0c2e66354549aeb13d73c512b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:40:13.905731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-DeleteServersTestJSON-700033058 Aug 22 05:40:13.905731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 822f0c2e66354549aeb13d73c512b09d Aug 22 05:40:13.905731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-DeleteServersTestJSON-700033058 Aug 22 05:40:13.905731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-DeleteServersTestJSON-700033058-project Aug 22 05:40:13.905731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:40:13.905731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:40:13.905731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 904630cc2e60419d88afd9cfc1c5914d Aug 22 05:40:13.905731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-DeleteServersTestJSON-700033058-project Aug 22 05:40:13.905731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:40:13.905731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:13.905731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '09fac986-176b-43b6-a4c4-c32b1513a3bf'} Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:40:13.906546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:13.908956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:40:13.910216 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-31e8eec7-04eb-4df0-af6d-eedc04b11cbe tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Returning 404 to user: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:40:13.910216 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-31e8eec7-04eb-4df0-af6d-eedc04b11cbe tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "DELETE /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 404 len: 111 microversion: 2.1 time: 0.040768 Aug 22 05:40:13.910216 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 140/282] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:40:13 2022] DELETE /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:40:13.915317 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c2ce9e40-df1c-4a37-9f36-72cd5379d54e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:13.915962 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c2ce9e40-df1c-4a37-9f36-72cd5379d54e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] [instance: 09fac986-176b-43b6-a4c4-c32b1513a3bf] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:13.922745 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c2ce9e40-df1c-4a37-9f36-72cd5379d54e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:13.923221 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c2ce9e40-df1c-4a37-9f36-72cd5379d54e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:13.923678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c2ce9e40-df1c-4a37-9f36-72cd5379d54e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:13.924364 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c2ce9e40-df1c-4a37-9f36-72cd5379d54e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:13.924800 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c2ce9e40-df1c-4a37-9f36-72cd5379d54e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:13.925212 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c2ce9e40-df1c-4a37-9f36-72cd5379d54e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:14.085839 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-c2ce9e40-df1c-4a37-9f36-72cd5379d54e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] HTTP exception thrown: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c2ce9e40-df1c-4a37-9f36-72cd5379d54e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Request method failure captured: Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf HTTP/1.1 Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxZKmKd-7tqKoNEa1iyqI9AYypIoCfe-QCSRP2i_poljuyx1q498ZIzmf51QF0Uy6pmfoj5b6Vvdul3mUgu3ogJAio2ouioogt2lbZP65x33kSmJNI8AitUTlAmoOIOrXwLflYZ-shM2ZvB2Q68MR-bXOuTiOydjjYCi1ySHLbnPVZw Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: 822f0c2e66354549aeb13d73c512b09d Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-DeleteServersTestJSON-700033058 Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:40:14.090373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:40:14.091880 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_822f0c2e66354549aeb13d73c512b09d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/822f0c2e66354549aeb13d73c512b09d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/822f0c2e66354549aeb13d73c512b09d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/822f0c2e66354549aeb13d73c512b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:40:14.091880 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-DeleteServersTestJSON-700033058 Aug 22 05:40:14.091880 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: 822f0c2e66354549aeb13d73c512b09d Aug 22 05:40:14.091880 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-DeleteServersTestJSON-700033058 Aug 22 05:40:14.091880 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-DeleteServersTestJSON-700033058-project Aug 22 05:40:14.091880 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:40:14.091880 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:40:14.091880 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: 904630cc2e60419d88afd9cfc1c5914d Aug 22 05:40:14.091880 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-DeleteServersTestJSON-700033058-project Aug 22 05:40:14.091880 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:40:14.091880 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:14.091880 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': '09fac986-176b-43b6-a4c4-c32b1513a3bf'} Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:40:14.093033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. Aug 22 05:40:14.094329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:40:14.095502 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c2ce9e40-df1c-4a37-9f36-72cd5379d54e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] Returning 404 to user: Instance 09fac986-176b-43b6-a4c4-c32b1513a3bf could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:40:14.095502 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c2ce9e40-df1c-4a37-9f36-72cd5379d54e tempest-DeleteServersTestJSON-700033058 tempest-DeleteServersTestJSON-700033058-project] 10.222.0.18 "GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf" status: 404 len: 111 microversion: 2.1 time: 0.180682 Aug 22 05:40:14.095502 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 143/283] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:13 2022] GET /compute/v2.1/servers/09fac986-176b-43b6-a4c4-c32b1513a3bf => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:40:14.758803 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9bdb2296-5362-47be-b637-9ed3f8b97226 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:14.759348 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9bdb2296-5362-47be-b637-9ed3f8b97226 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:14.766727 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bdb2296-5362-47be-b637-9ed3f8b97226 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:14.767208 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bdb2296-5362-47be-b637-9ed3f8b97226 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:14.767903 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bdb2296-5362-47be-b637-9ed3f8b97226 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:14.768946 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bdb2296-5362-47be-b637-9ed3f8b97226 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:14.769403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bdb2296-5362-47be-b637-9ed3f8b97226 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:14.769856 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bdb2296-5362-47be-b637-9ed3f8b97226 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:15.022204 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9bdb2296-5362-47be-b637-9ed3f8b97226 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:15.032209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9bdb2296-5362-47be-b637-9ed3f8b97226 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.277600 Aug 22 05:40:15.043651 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 141/284] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:14 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:16.057978 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4377b8a9-72d8-46fb-808a-43003e44e8fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:16.058764 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4377b8a9-72d8-46fb-808a-43003e44e8fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:16.070096 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4377b8a9-72d8-46fb-808a-43003e44e8fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:16.070611 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4377b8a9-72d8-46fb-808a-43003e44e8fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:16.071010 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4377b8a9-72d8-46fb-808a-43003e44e8fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:16.072084 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4377b8a9-72d8-46fb-808a-43003e44e8fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:16.072762 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4377b8a9-72d8-46fb-808a-43003e44e8fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:16.074518 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4377b8a9-72d8-46fb-808a-43003e44e8fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:16.079874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:40:16.293157 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4377b8a9-72d8-46fb-808a-43003e44e8fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:16.302391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4377b8a9-72d8-46fb-808a-43003e44e8fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.248331 Aug 22 05:40:16.303335 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 144/285] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:16 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:17.336900 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f2711452-883c-436a-93ff-772b7c891737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:17.338121 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f2711452-883c-436a-93ff-772b7c891737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:17.359977 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2711452-883c-436a-93ff-772b7c891737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:17.360995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2711452-883c-436a-93ff-772b7c891737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:17.365025 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2711452-883c-436a-93ff-772b7c891737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:17.366044 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2711452-883c-436a-93ff-772b7c891737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:17.367706 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2711452-883c-436a-93ff-772b7c891737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:17.368351 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2711452-883c-436a-93ff-772b7c891737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:18.024910 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f2711452-883c-436a-93ff-772b7c891737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:18.039981 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f2711452-883c-436a-93ff-772b7c891737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.718479 Aug 22 05:40:18.040888 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 142/286] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:17 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:19.065131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c404e869-d293-4e40-9270-8bcc93ce2bb7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:19.066639 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c404e869-d293-4e40-9270-8bcc93ce2bb7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:19.081615 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c404e869-d293-4e40-9270-8bcc93ce2bb7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:19.082670 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c404e869-d293-4e40-9270-8bcc93ce2bb7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:19.083180 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c404e869-d293-4e40-9270-8bcc93ce2bb7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:19.084923 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c404e869-d293-4e40-9270-8bcc93ce2bb7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:19.085885 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c404e869-d293-4e40-9270-8bcc93ce2bb7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:19.086528 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c404e869-d293-4e40-9270-8bcc93ce2bb7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:19.317488 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c404e869-d293-4e40-9270-8bcc93ce2bb7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:19.326040 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c404e869-d293-4e40-9270-8bcc93ce2bb7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.267214 Aug 22 05:40:19.326611 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 145/287] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:19 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:20.357379 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7bb1c35f-232a-47cf-a8d8-a35e393772cd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:20.358953 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7bb1c35f-232a-47cf-a8d8-a35e393772cd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:20.366609 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bb1c35f-232a-47cf-a8d8-a35e393772cd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:20.368121 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bb1c35f-232a-47cf-a8d8-a35e393772cd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:20.368824 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bb1c35f-232a-47cf-a8d8-a35e393772cd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:20.369638 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bb1c35f-232a-47cf-a8d8-a35e393772cd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:20.370475 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bb1c35f-232a-47cf-a8d8-a35e393772cd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:20.371002 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bb1c35f-232a-47cf-a8d8-a35e393772cd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:20.576403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7bb1c35f-232a-47cf-a8d8-a35e393772cd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:20.585478 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7bb1c35f-232a-47cf-a8d8-a35e393772cd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.237724 Aug 22 05:40:20.586099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 143/288] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:20 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:21.610966 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-66cd8a7a-ec18-47e9-baab-e2d40893dc01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:21.611784 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-66cd8a7a-ec18-47e9-baab-e2d40893dc01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:21.619157 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-66cd8a7a-ec18-47e9-baab-e2d40893dc01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:21.620845 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-66cd8a7a-ec18-47e9-baab-e2d40893dc01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:21.625677 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-66cd8a7a-ec18-47e9-baab-e2d40893dc01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:21.626561 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-66cd8a7a-ec18-47e9-baab-e2d40893dc01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:21.627120 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-66cd8a7a-ec18-47e9-baab-e2d40893dc01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:21.628661 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-66cd8a7a-ec18-47e9-baab-e2d40893dc01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:21.945073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1322139912", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452", "networks": [{"uuid": "8f1e16bf-0f88-4299-8ce3-c3baf34be992"}]}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:40:21.966740 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=42 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:40:21.984550 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-66cd8a7a-ec18-47e9-baab-e2d40893dc01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:21.999041 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-66cd8a7a-ec18-47e9-baab-e2d40893dc01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.392846 Aug 22 05:40:22.014445 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 146/289] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:21 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:23.022687 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6705f3b5-9d90-4ba7-b85c-c5710d7bde67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:23.023461 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-6705f3b5-9d90-4ba7-b85c-c5710d7bde67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:23.032304 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6705f3b5-9d90-4ba7-b85c-c5710d7bde67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:23.032778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6705f3b5-9d90-4ba7-b85c-c5710d7bde67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:23.033241 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6705f3b5-9d90-4ba7-b85c-c5710d7bde67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:23.033966 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6705f3b5-9d90-4ba7-b85c-c5710d7bde67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:23.034441 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6705f3b5-9d90-4ba7-b85c-c5710d7bde67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:23.034864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6705f3b5-9d90-4ba7-b85c-c5710d7bde67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:23.328306 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6705f3b5-9d90-4ba7-b85c-c5710d7bde67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:23.340097 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6705f3b5-9d90-4ba7-b85c-c5710d7bde67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.321336 Aug 22 05:40:23.340665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 147/290] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:23 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:24.365180 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-dd396253-71db-4547-9689-06e8a36a4936 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:24.367048 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-dd396253-71db-4547-9689-06e8a36a4936 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:24.375025 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd396253-71db-4547-9689-06e8a36a4936 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:24.376228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd396253-71db-4547-9689-06e8a36a4936 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:24.376910 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd396253-71db-4547-9689-06e8a36a4936 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:24.378060 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd396253-71db-4547-9689-06e8a36a4936 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:24.378773 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd396253-71db-4547-9689-06e8a36a4936 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:24.379261 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dd396253-71db-4547-9689-06e8a36a4936 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:24.532079 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-dd396253-71db-4547-9689-06e8a36a4936 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:24.541755 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-dd396253-71db-4547-9689-06e8a36a4936 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.180636 Aug 22 05:40:24.542377 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 148/291] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:24 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:25.568437 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8f0e73ef-3a3e-4f70-a6d4-3ef4c3be7694 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:25.570353 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8f0e73ef-3a3e-4f70-a6d4-3ef4c3be7694 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:25.577674 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8f0e73ef-3a3e-4f70-a6d4-3ef4c3be7694 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:25.578517 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8f0e73ef-3a3e-4f70-a6d4-3ef4c3be7694 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:25.579110 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8f0e73ef-3a3e-4f70-a6d4-3ef4c3be7694 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:25.580162 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8f0e73ef-3a3e-4f70-a6d4-3ef4c3be7694 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:25.580905 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8f0e73ef-3a3e-4f70-a6d4-3ef4c3be7694 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:25.581491 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8f0e73ef-3a3e-4f70-a6d4-3ef4c3be7694 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:25.823948 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8f0e73ef-3a3e-4f70-a6d4-3ef4c3be7694 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:25.844440 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8f0e73ef-3a3e-4f70-a6d4-3ef4c3be7694 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.284163 Aug 22 05:40:25.845040 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 149/292] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:25 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:26.080524 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-005df0f1-cc64-4a08-b0b1-43e331cbdb98 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Action: 'create', calling method: .version_select at 0x7f0b3e122ca0>, body: {"keypair": {"name": "tempest-keypair-350476886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOkz9kONKDfdc/XF6RCdk2yYNMIvfMDJ4ursJ6J+rjGSUI0dGMk9PFni7XuenCdbX8ss6nawpfzKOIDhxjdCIOhcX0stBkbT/xYVzs7Ni6uMcQCyrrauR2aJ3SvzfinHQ=="}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:40:26.110007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-005df0f1-cc64-4a08-b0b1-43e331cbdb98 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Getting quotas for project e27e3216211942959311372c2d078202. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:40:26.118990 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-005df0f1-cc64-4a08-b0b1-43e331cbdb98 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Getting quotas for user 2864050fd1a64646a8760f0172be8f4a and project e27e3216211942959311372c2d078202. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:40:26.176960 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-005df0f1-cc64-4a08-b0b1-43e331cbdb98 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.326282 Aug 22 05:40:26.188136 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 150/293] 10.222.0.18 () {62 vars in 1200 bytes} [Mon Aug 22 05:40:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 342 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 05:40:26.866310 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-cff096ed-2017-447d-b3b5-459e9a6fa369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:26.866962 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-cff096ed-2017-447d-b3b5-459e9a6fa369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:26.875852 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cff096ed-2017-447d-b3b5-459e9a6fa369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:26.876311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cff096ed-2017-447d-b3b5-459e9a6fa369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:26.876743 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cff096ed-2017-447d-b3b5-459e9a6fa369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:26.877448 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cff096ed-2017-447d-b3b5-459e9a6fa369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:26.877895 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cff096ed-2017-447d-b3b5-459e9a6fa369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:26.878311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cff096ed-2017-447d-b3b5-459e9a6fa369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:27.204097 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-cff096ed-2017-447d-b3b5-459e9a6fa369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:27.216109 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-cff096ed-2017-447d-b3b5-459e9a6fa369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.353998 Aug 22 05:40:27.216946 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 151/294] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:26 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:40:27.964323 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] validate_networks() for [('8f1e16bf-0f88-4299-8ce3-c3baf34be992', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:40:27.986151 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1381749032", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ca0f691b-0b03-4da0-a433-7d2fc12c78d9"}], "security_groups": [{"name": "tempest-securitygroup--974534741"}], "key_name": "tempest-keypair-350476886", "user_data": "}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:40:28.148955 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.network.neutron [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] validate_networks() for [('ca0f691b-0b03-4da0-a433-7d2fc12c78d9', None, None, None, None, None)] {{(pid=132497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:40:28.904249 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:40:28.904951 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:40:28.905576 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:40:28.906130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:40:28.906687 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:40:28.924912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:28.925637 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:28.926221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:28.927084 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:28.927731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:28.928299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:28.939173 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=91 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:40:28.954277 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Getting quotas for project 375a7cf8cbc042a187f2b144d907c175. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:40:28.961373 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Getting quotas for user bf99219df4fb45a4b7ec5fea537f8be2 and project 375a7cf8cbc042a187f2b144d907c175. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:40:28.988201 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:40:28.993719 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:40:29.056778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Flavor limits 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:40:29.057776 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Image limits 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:40:29.058428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Flavor pref 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:40:29.059030 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Image pref 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:40:29.059140 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f982fecc-2f49-4aee-bd80-7d8be8d58d7f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.120937 Aug 22 05:40:29.059933 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:40:29.060066 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 144/295] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:40:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 7123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:40:29.065352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5dcca8bc-b559-49d9-a73a-e918f561cfa2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:29.066391 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5dcca8bc-b559-49d9-a73a-e918f561cfa2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:29.073183 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5dcca8bc-b559-49d9-a73a-e918f561cfa2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:29.073537 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5dcca8bc-b559-49d9-a73a-e918f561cfa2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:29.073973 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5dcca8bc-b559-49d9-a73a-e918f561cfa2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:29.074665 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5dcca8bc-b559-49d9-a73a-e918f561cfa2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:29.075332 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5dcca8bc-b559-49d9-a73a-e918f561cfa2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:29.075860 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:29.076393 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:29.076589 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5dcca8bc-b559-49d9-a73a-e918f561cfa2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:29.077623 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:29.078760 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:29.080626 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:29.083042 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:29.109845 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Getting quotas for project e27e3216211942959311372c2d078202. Resources: {'cores', 'instances', 'ram'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:40:29.114197 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Getting quotas for user 2864050fd1a64646a8760f0172be8f4a and project e27e3216211942959311372c2d078202. Resources: {'cores', 'instances', 'ram'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:40:29.129684 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Going to run 1 instances... {{(pid=132497) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:40:29.132268 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:40:29.230749 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-3c1b9d12-a6c9-45eb-a512-4d986a9f609b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.247791 Aug 22 05:40:29.232699 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 152/296] 10.222.0.18 () {62 vars in 1188 bytes} [Mon Aug 22 05:40:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 1252 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 22 05:40:29.245267 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-eff68257-b387-402e-87b4-41d23b5228b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:29.249450 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-eff68257-b387-402e-87b4-41d23b5228b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:29.371718 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-eff68257-b387-402e-87b4-41d23b5228b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:29.384768 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-eff68257-b387-402e-87b4-41d23b5228b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1214 microversion: 2.1 time: 0.150299 Aug 22 05:40:29.391070 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 153/297] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:29 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:29.404345 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5dcca8bc-b559-49d9-a73a-e918f561cfa2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:29.412928 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5dcca8bc-b559-49d9-a73a-e918f561cfa2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.351275 Aug 22 05:40:29.414009 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 145/298] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:29 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:29.415755 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-588b71b1-9925-4b25-a429-5c31211862c9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:29.418432 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-588b71b1-9925-4b25-a429-5c31211862c9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:29.509974 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-588b71b1-9925-4b25-a429-5c31211862c9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:29.526169 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-588b71b1-9925-4b25-a429-5c31211862c9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:29.530382 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-588b71b1-9925-4b25-a429-5c31211862c9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:29.531944 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-588b71b1-9925-4b25-a429-5c31211862c9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1281 microversion: 2.20 time: 0.139240 Aug 22 05:40:29.533370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 154/299] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:29 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1281 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:30.406792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-970a640b-2702-41f1-b1b7-8e18a30f5b88 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:30.407480 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-970a640b-2702-41f1-b1b7-8e18a30f5b88 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:30.415003 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-970a640b-2702-41f1-b1b7-8e18a30f5b88 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:30.415735 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-970a640b-2702-41f1-b1b7-8e18a30f5b88 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:30.416464 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-970a640b-2702-41f1-b1b7-8e18a30f5b88 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:30.417344 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-970a640b-2702-41f1-b1b7-8e18a30f5b88 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:30.417973 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-970a640b-2702-41f1-b1b7-8e18a30f5b88 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:30.418557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-970a640b-2702-41f1-b1b7-8e18a30f5b88 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:30.436399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-031ee2c9-a3a8-4d41-94e8-4200402fa89f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:30.437017 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-031ee2c9-a3a8-4d41-94e8-4200402fa89f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:30.443897 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-031ee2c9-a3a8-4d41-94e8-4200402fa89f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:30.444587 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-031ee2c9-a3a8-4d41-94e8-4200402fa89f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:30.445168 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-031ee2c9-a3a8-4d41-94e8-4200402fa89f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:30.446252 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-031ee2c9-a3a8-4d41-94e8-4200402fa89f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:30.446861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-031ee2c9-a3a8-4d41-94e8-4200402fa89f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:30.447423 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-031ee2c9-a3a8-4d41-94e8-4200402fa89f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:30.499149 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-970a640b-2702-41f1-b1b7-8e18a30f5b88 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:30.510642 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-970a640b-2702-41f1-b1b7-8e18a30f5b88 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1266 microversion: 2.1 time: 0.107831 Aug 22 05:40:30.511238 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 146/300] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:30 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:30.555797 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7530dd05-5b49-4677-9917-45f87e4adf98 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:30.556736 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7530dd05-5b49-4677-9917-45f87e4adf98 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:30.564027 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7530dd05-5b49-4677-9917-45f87e4adf98 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:30.564313 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7530dd05-5b49-4677-9917-45f87e4adf98 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:30.564736 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7530dd05-5b49-4677-9917-45f87e4adf98 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:30.565616 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7530dd05-5b49-4677-9917-45f87e4adf98 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:30.566133 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7530dd05-5b49-4677-9917-45f87e4adf98 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:30.567161 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7530dd05-5b49-4677-9917-45f87e4adf98 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:30.647718 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7530dd05-5b49-4677-9917-45f87e4adf98 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:30.651226 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-031ee2c9-a3a8-4d41-94e8-4200402fa89f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:30.657959 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7530dd05-5b49-4677-9917-45f87e4adf98 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:30.659379 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7530dd05-5b49-4677-9917-45f87e4adf98 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:30.659836 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-031ee2c9-a3a8-4d41-94e8-4200402fa89f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1520 microversion: 2.1 time: 0.229293 Aug 22 05:40:30.660478 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 155/301] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:30 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:30.660575 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7530dd05-5b49-4677-9917-45f87e4adf98 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1333 microversion: 2.20 time: 0.108957 Aug 22 05:40:30.661185 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 147/302] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:30 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1333 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:31.533583 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-143e9700-fd75-42fc-9c8d-7d620865e49b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:31.534348 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-143e9700-fd75-42fc-9c8d-7d620865e49b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:31.548998 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-143e9700-fd75-42fc-9c8d-7d620865e49b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:31.549712 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-143e9700-fd75-42fc-9c8d-7d620865e49b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:31.550146 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-143e9700-fd75-42fc-9c8d-7d620865e49b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:31.550853 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-143e9700-fd75-42fc-9c8d-7d620865e49b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:31.551310 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-143e9700-fd75-42fc-9c8d-7d620865e49b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:31.551792 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-143e9700-fd75-42fc-9c8d-7d620865e49b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:31.653957 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-143e9700-fd75-42fc-9c8d-7d620865e49b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:31.662266 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-143e9700-fd75-42fc-9c8d-7d620865e49b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1274 microversion: 2.1 time: 0.132943 Aug 22 05:40:31.662845 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 156/303] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:31 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:31.681178 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2879e961-a464-4480-9bbf-c3ab2591c570 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:31.682506 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2879e961-a464-4480-9bbf-c3ab2591c570 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:31.683971 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-79af3612-089c-4ffa-9dd1-eb3a217156c2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:31.684982 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-79af3612-089c-4ffa-9dd1-eb3a217156c2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:31.689501 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2879e961-a464-4480-9bbf-c3ab2591c570 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:31.689984 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2879e961-a464-4480-9bbf-c3ab2591c570 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:31.690600 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2879e961-a464-4480-9bbf-c3ab2591c570 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:31.691291 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2879e961-a464-4480-9bbf-c3ab2591c570 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:31.692141 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2879e961-a464-4480-9bbf-c3ab2591c570 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:31.692327 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-79af3612-089c-4ffa-9dd1-eb3a217156c2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:31.692562 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2879e961-a464-4480-9bbf-c3ab2591c570 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:31.692985 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-79af3612-089c-4ffa-9dd1-eb3a217156c2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:31.693512 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-79af3612-089c-4ffa-9dd1-eb3a217156c2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:31.694301 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-79af3612-089c-4ffa-9dd1-eb3a217156c2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:31.694856 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-79af3612-089c-4ffa-9dd1-eb3a217156c2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:31.695491 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-79af3612-089c-4ffa-9dd1-eb3a217156c2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:31.788988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-79af3612-089c-4ffa-9dd1-eb3a217156c2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:31.797255 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-79af3612-089c-4ffa-9dd1-eb3a217156c2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:31.798757 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-79af3612-089c-4ffa-9dd1-eb3a217156c2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:31.799884 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-79af3612-089c-4ffa-9dd1-eb3a217156c2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1341 microversion: 2.20 time: 0.121066 Aug 22 05:40:31.800435 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 157/304] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:31 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1341 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:31.857185 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2879e961-a464-4480-9bbf-c3ab2591c570 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:31.865339 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2879e961-a464-4480-9bbf-c3ab2591c570 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1500 microversion: 2.1 time: 0.188053 Aug 22 05:40:31.865881 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 148/305] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:31 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1500 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:31.885371 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0fb87790-7fc2-4b64-bb56-950e9ed48f09 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:31.885975 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0fb87790-7fc2-4b64-bb56-950e9ed48f09 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:31.892479 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0fb87790-7fc2-4b64-bb56-950e9ed48f09 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:31.892943 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0fb87790-7fc2-4b64-bb56-950e9ed48f09 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:31.893373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0fb87790-7fc2-4b64-bb56-950e9ed48f09 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:31.894051 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0fb87790-7fc2-4b64-bb56-950e9ed48f09 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:31.894505 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0fb87790-7fc2-4b64-bb56-950e9ed48f09 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:31.894889 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0fb87790-7fc2-4b64-bb56-950e9ed48f09 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:32.036234 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0fb87790-7fc2-4b64-bb56-950e9ed48f09 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:32.045994 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0fb87790-7fc2-4b64-bb56-950e9ed48f09 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1515 microversion: 2.1 time: 0.164389 Aug 22 05:40:32.048676 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 158/306] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:31 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:32.696750 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9a823c77-e8ff-4167-a5f3-9a997d13fe0a tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:32.697484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9a823c77-e8ff-4167-a5f3-9a997d13fe0a tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:32.704497 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a823c77-e8ff-4167-a5f3-9a997d13fe0a tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:32.704980 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a823c77-e8ff-4167-a5f3-9a997d13fe0a tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:32.705466 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a823c77-e8ff-4167-a5f3-9a997d13fe0a tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:32.706169 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a823c77-e8ff-4167-a5f3-9a997d13fe0a tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:32.706619 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a823c77-e8ff-4167-a5f3-9a997d13fe0a tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:32.707098 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a823c77-e8ff-4167-a5f3-9a997d13fe0a tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:32.779445 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9a823c77-e8ff-4167-a5f3-9a997d13fe0a tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:32.787895 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9a823c77-e8ff-4167-a5f3-9a997d13fe0a tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1272 microversion: 2.1 time: 0.099663 Aug 22 05:40:32.788823 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 149/307] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:32 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:40:32.822620 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-65cc7831-86aa-4b7a-bc61-152f94bf27da tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:32.823320 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-65cc7831-86aa-4b7a-bc61-152f94bf27da tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:32.830421 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-65cc7831-86aa-4b7a-bc61-152f94bf27da tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:32.831273 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-65cc7831-86aa-4b7a-bc61-152f94bf27da tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:32.831943 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-65cc7831-86aa-4b7a-bc61-152f94bf27da tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:32.832856 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-65cc7831-86aa-4b7a-bc61-152f94bf27da tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:32.833755 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-65cc7831-86aa-4b7a-bc61-152f94bf27da tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:32.834390 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-65cc7831-86aa-4b7a-bc61-152f94bf27da tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:32.929282 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-65cc7831-86aa-4b7a-bc61-152f94bf27da tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:32.941008 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-65cc7831-86aa-4b7a-bc61-152f94bf27da tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:32.942500 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-65cc7831-86aa-4b7a-bc61-152f94bf27da tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:32.944566 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-65cc7831-86aa-4b7a-bc61-152f94bf27da tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1339 microversion: 2.20 time: 0.126060 Aug 22 05:40:32.945133 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 159/308] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:32 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1339 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:33.810377 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7e84375d-a95e-4b9c-be21-2d29e4e8f717 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:33.811725 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7e84375d-a95e-4b9c-be21-2d29e4e8f717 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:33.817801 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e84375d-a95e-4b9c-be21-2d29e4e8f717 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:33.818350 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e84375d-a95e-4b9c-be21-2d29e4e8f717 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:33.818839 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e84375d-a95e-4b9c-be21-2d29e4e8f717 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:33.819603 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e84375d-a95e-4b9c-be21-2d29e4e8f717 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:33.820153 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e84375d-a95e-4b9c-be21-2d29e4e8f717 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:33.820640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e84375d-a95e-4b9c-be21-2d29e4e8f717 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:33.957087 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7e84375d-a95e-4b9c-be21-2d29e4e8f717 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:33.967637 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7e84375d-a95e-4b9c-be21-2d29e4e8f717 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1314 microversion: 2.1 time: 0.158983 Aug 22 05:40:33.967821 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-fb249a11-f87f-4b20-b747-f6642524a56f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:33.968379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-fb249a11-f87f-4b20-b747-f6642524a56f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:33.977327 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fb249a11-f87f-4b20-b747-f6642524a56f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:33.977807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fb249a11-f87f-4b20-b747-f6642524a56f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:33.978215 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fb249a11-f87f-4b20-b747-f6642524a56f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:33.980439 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fb249a11-f87f-4b20-b747-f6642524a56f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:33.980879 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fb249a11-f87f-4b20-b747-f6642524a56f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:33.981017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 150/309] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:33 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:33.982374 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fb249a11-f87f-4b20-b747-f6642524a56f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:34.108771 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-308b69a1-86b9-43d4-8fdf-265a6e89f95d req-67304aba-6f1d-42c5-93f0-643e759a3977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aac67d5-bccb-4405-83fc-a0539b68e34a", "tag": "d0e3f633-f38e-4fad-9ba1-9b3eed69eb5a"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:40:34.125010 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-308b69a1-86b9-43d4-8fdf-265a6e89f95d req-67304aba-6f1d-42c5-93f0-643e759a3977 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:34.125602 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-308b69a1-86b9-43d4-8fdf-265a6e89f95d req-67304aba-6f1d-42c5-93f0-643e759a3977 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:34.126442 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-308b69a1-86b9-43d4-8fdf-265a6e89f95d req-67304aba-6f1d-42c5-93f0-643e759a3977 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:34.133536 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-fb249a11-f87f-4b20-b747-f6642524a56f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:34.142570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-308b69a1-86b9-43d4-8fdf-265a6e89f95d req-67304aba-6f1d-42c5-93f0-643e759a3977 service nova] Creating event network-changed:d0e3f633-f38e-4fad-9ba1-9b3eed69eb5a for instance 0aac67d5-bccb-4405-83fc-a0539b68e34a on hv-cinder-85391 Aug 22 05:40:34.144327 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-fb249a11-f87f-4b20-b747-f6642524a56f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:34.145918 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-fb249a11-f87f-4b20-b747-f6642524a56f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:34.147022 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-fb249a11-f87f-4b20-b747-f6642524a56f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1406 microversion: 2.20 time: 0.184025 Aug 22 05:40:34.147771 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 160/310] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:33 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:34.149636 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-308b69a1-86b9-43d4-8fdf-265a6e89f95d req-67304aba-6f1d-42c5-93f0-643e759a3977 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047330 Aug 22 05:40:34.150228 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 151/311] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:40:34.593670 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4c86f3b1-db67-47b0-bd5d-62304f530e77 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:40:34.596956 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4c86f3b1-db67-47b0-bd5d-62304f530e77 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:34.604468 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c86f3b1-db67-47b0-bd5d-62304f530e77 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:34.605340 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c86f3b1-db67-47b0-bd5d-62304f530e77 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:34.605941 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c86f3b1-db67-47b0-bd5d-62304f530e77 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:34.607012 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c86f3b1-db67-47b0-bd5d-62304f530e77 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:34.607684 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c86f3b1-db67-47b0-bd5d-62304f530e77 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:34.608252 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c86f3b1-db67-47b0-bd5d-62304f530e77 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:34.635409 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.objects.instance [None req-4c86f3b1-db67-47b0-bd5d-62304f530e77 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lazy-loading 'flavor' on Instance uuid f8ee8e71-810f-4f41-af8a-9bed26135368 {{(pid=132497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:40:34.722486 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4c86f3b1-db67-47b0-bd5d-62304f530e77 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "POST /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368/action" status: 200 len: 32 microversion: 2.1 time: 0.136218 Aug 22 05:40:34.723081 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 161/312] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 22 05:40:34 2022] POST /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368/action => generated 32 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 05:40:34.733767 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4b7caacf-bc60-4cec-9549-78a8a3fce12b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:34.734436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4b7caacf-bc60-4cec-9549-78a8a3fce12b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:34.741271 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b7caacf-bc60-4cec-9549-78a8a3fce12b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:34.742054 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b7caacf-bc60-4cec-9549-78a8a3fce12b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:34.742707 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b7caacf-bc60-4cec-9549-78a8a3fce12b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:34.743692 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b7caacf-bc60-4cec-9549-78a8a3fce12b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:34.744354 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b7caacf-bc60-4cec-9549-78a8a3fce12b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:34.745037 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b7caacf-bc60-4cec-9549-78a8a3fce12b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:34.989324 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-87e4d928-16a4-4d3d-88da-0fa8b67def45 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:34.989964 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-87e4d928-16a4-4d3d-88da-0fa8b67def45 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:34.996321 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-87e4d928-16a4-4d3d-88da-0fa8b67def45 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:34.996881 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-87e4d928-16a4-4d3d-88da-0fa8b67def45 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:34.997643 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-87e4d928-16a4-4d3d-88da-0fa8b67def45 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:34.998610 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-87e4d928-16a4-4d3d-88da-0fa8b67def45 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:34.999081 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-87e4d928-16a4-4d3d-88da-0fa8b67def45 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:34.999763 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-87e4d928-16a4-4d3d-88da-0fa8b67def45 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:35.025222 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:40:35.061405 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4b7caacf-bc60-4cec-9549-78a8a3fce12b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:35.071015 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4b7caacf-bc60-4cec-9549-78a8a3fce12b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.342166 Aug 22 05:40:35.071666 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 152/313] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:34 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:35.145370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-87e4d928-16a4-4d3d-88da-0fa8b67def45 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:35.156277 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-87e4d928-16a4-4d3d-88da-0fa8b67def45 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1314 microversion: 2.1 time: 0.171662 Aug 22 05:40:35.156850 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 162/314] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:34 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:40:35.169488 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-618a459c-80b5-49f5-b316-d4426cde9eda tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:35.170084 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-618a459c-80b5-49f5-b316-d4426cde9eda tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:35.176534 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-618a459c-80b5-49f5-b316-d4426cde9eda tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:35.177039 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-618a459c-80b5-49f5-b316-d4426cde9eda tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:35.177464 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-618a459c-80b5-49f5-b316-d4426cde9eda tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:35.178144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-618a459c-80b5-49f5-b316-d4426cde9eda tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:35.178582 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-618a459c-80b5-49f5-b316-d4426cde9eda tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:35.178990 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-618a459c-80b5-49f5-b316-d4426cde9eda tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:35.313459 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-618a459c-80b5-49f5-b316-d4426cde9eda tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:35.325814 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-618a459c-80b5-49f5-b316-d4426cde9eda tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:35.327306 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-618a459c-80b5-49f5-b316-d4426cde9eda tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:35.328428 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-618a459c-80b5-49f5-b316-d4426cde9eda tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1406 microversion: 2.20 time: 0.162890 Aug 22 05:40:35.328984 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 153/315] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:35 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:36.096584 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ba91a819-b4ba-4ff1-b69d-a4c1d4451109 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:36.097586 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ba91a819-b4ba-4ff1-b69d-a4c1d4451109 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:36.108610 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba91a819-b4ba-4ff1-b69d-a4c1d4451109 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:36.109027 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba91a819-b4ba-4ff1-b69d-a4c1d4451109 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:36.109456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba91a819-b4ba-4ff1-b69d-a4c1d4451109 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:36.110916 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba91a819-b4ba-4ff1-b69d-a4c1d4451109 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:36.110916 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba91a819-b4ba-4ff1-b69d-a4c1d4451109 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:36.111143 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba91a819-b4ba-4ff1-b69d-a4c1d4451109 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:36.177287 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-292328ff-e1f1-4756-a56d-79bf115205a0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:36.178426 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-292328ff-e1f1-4756-a56d-79bf115205a0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:36.185520 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-292328ff-e1f1-4756-a56d-79bf115205a0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:36.186271 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-292328ff-e1f1-4756-a56d-79bf115205a0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:36.186704 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-292328ff-e1f1-4756-a56d-79bf115205a0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:36.187499 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-292328ff-e1f1-4756-a56d-79bf115205a0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:36.188027 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-292328ff-e1f1-4756-a56d-79bf115205a0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:36.188450 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-292328ff-e1f1-4756-a56d-79bf115205a0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:36.283311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ba91a819-b4ba-4ff1-b69d-a4c1d4451109 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:36.292370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ba91a819-b4ba-4ff1-b69d-a4c1d4451109 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.202729 Aug 22 05:40:36.292938 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 163/316] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:36 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:36.298192 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-8a7eca76-2fe1-4550-aa9e-a3e1c9558f15 req-8d225527-3f31-43fc-a260-5f6d034e1817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb", "tag": "4c76faf8-d367-4a1e-9d06-cc6e666badde"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:40:36.307358 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-8a7eca76-2fe1-4550-aa9e-a3e1c9558f15 req-8d225527-3f31-43fc-a260-5f6d034e1817 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:36.308069 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-8a7eca76-2fe1-4550-aa9e-a3e1c9558f15 req-8d225527-3f31-43fc-a260-5f6d034e1817 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:36.308480 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-8a7eca76-2fe1-4550-aa9e-a3e1c9558f15 req-8d225527-3f31-43fc-a260-5f6d034e1817 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:36.319414 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-8a7eca76-2fe1-4550-aa9e-a3e1c9558f15 req-8d225527-3f31-43fc-a260-5f6d034e1817 service nova] Creating event network-changed:4c76faf8-d367-4a1e-9d06-cc6e666badde for instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb on hv-cinder-85391 Aug 22 05:40:36.324272 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-8a7eca76-2fe1-4550-aa9e-a3e1c9558f15 req-8d225527-3f31-43fc-a260-5f6d034e1817 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030082 Aug 22 05:40:36.328175 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 164/317] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:40:36.352238 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e145b89c-aa27-40d8-a3a7-9f3636db0757 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:36.353208 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e145b89c-aa27-40d8-a3a7-9f3636db0757 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:36.357406 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-292328ff-e1f1-4756-a56d-79bf115205a0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:36.361039 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e145b89c-aa27-40d8-a3a7-9f3636db0757 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:36.361499 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e145b89c-aa27-40d8-a3a7-9f3636db0757 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:36.361924 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e145b89c-aa27-40d8-a3a7-9f3636db0757 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:36.362624 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e145b89c-aa27-40d8-a3a7-9f3636db0757 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:36.363106 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e145b89c-aa27-40d8-a3a7-9f3636db0757 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:36.363787 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e145b89c-aa27-40d8-a3a7-9f3636db0757 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:36.365407 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-292328ff-e1f1-4756-a56d-79bf115205a0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1314 microversion: 2.1 time: 0.192131 Aug 22 05:40:36.366181 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 154/318] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:36 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:36.511370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e145b89c-aa27-40d8-a3a7-9f3636db0757 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:36.520690 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e145b89c-aa27-40d8-a3a7-9f3636db0757 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:36.522562 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e145b89c-aa27-40d8-a3a7-9f3636db0757 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:36.523682 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e145b89c-aa27-40d8-a3a7-9f3636db0757 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1406 microversion: 2.20 time: 0.175958 Aug 22 05:40:36.524238 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 165/319] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:36 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 05:40:37.317567 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-87e4f2f1-facd-4c1d-adee-4b3eec21431a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:37.318427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-87e4f2f1-facd-4c1d-adee-4b3eec21431a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:37.329027 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87e4f2f1-facd-4c1d-adee-4b3eec21431a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:37.329847 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87e4f2f1-facd-4c1d-adee-4b3eec21431a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:37.330563 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87e4f2f1-facd-4c1d-adee-4b3eec21431a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:37.331705 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87e4f2f1-facd-4c1d-adee-4b3eec21431a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:37.332470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87e4f2f1-facd-4c1d-adee-4b3eec21431a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:37.333162 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87e4f2f1-facd-4c1d-adee-4b3eec21431a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:37.387683 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-30c8863f-b303-4415-b50a-c3bdb322e283 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:37.388941 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-30c8863f-b303-4415-b50a-c3bdb322e283 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:37.396004 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-30c8863f-b303-4415-b50a-c3bdb322e283 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:37.396488 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-30c8863f-b303-4415-b50a-c3bdb322e283 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:37.396919 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-30c8863f-b303-4415-b50a-c3bdb322e283 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:37.397677 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-30c8863f-b303-4415-b50a-c3bdb322e283 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:37.398127 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-30c8863f-b303-4415-b50a-c3bdb322e283 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:37.398543 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-30c8863f-b303-4415-b50a-c3bdb322e283 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:37.521144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-87e4f2f1-facd-4c1d-adee-4b3eec21431a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:37.530016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-87e4f2f1-facd-4c1d-adee-4b3eec21431a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.218979 Aug 22 05:40:37.530827 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 155/320] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:37 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:37.551440 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ee45b14d-c112-40af-a9b1-a671a54798cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:37.552069 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ee45b14d-c112-40af-a9b1-a671a54798cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:37.558056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee45b14d-c112-40af-a9b1-a671a54798cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:37.558529 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee45b14d-c112-40af-a9b1-a671a54798cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:37.558953 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee45b14d-c112-40af-a9b1-a671a54798cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:37.559679 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee45b14d-c112-40af-a9b1-a671a54798cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:37.560141 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee45b14d-c112-40af-a9b1-a671a54798cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:37.560554 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee45b14d-c112-40af-a9b1-a671a54798cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:37.566365 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-30c8863f-b303-4415-b50a-c3bdb322e283 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:37.574140 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-30c8863f-b303-4415-b50a-c3bdb322e283 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1314 microversion: 2.1 time: 0.191022 Aug 22 05:40:37.574622 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 166/321] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:37 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:37.695783 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ee45b14d-c112-40af-a9b1-a671a54798cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:37.704343 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ee45b14d-c112-40af-a9b1-a671a54798cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:37.705833 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ee45b14d-c112-40af-a9b1-a671a54798cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:37.706914 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ee45b14d-c112-40af-a9b1-a671a54798cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1406 microversion: 2.20 time: 0.159406 Aug 22 05:40:37.707490 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 156/322] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:37 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 05:40:38.563745 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-12f8bb1b-a191-47ac-a061-7fb60c7664cb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:38.564335 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-12f8bb1b-a191-47ac-a061-7fb60c7664cb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:38.570868 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-12f8bb1b-a191-47ac-a061-7fb60c7664cb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:38.571342 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-12f8bb1b-a191-47ac-a061-7fb60c7664cb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:38.571796 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-12f8bb1b-a191-47ac-a061-7fb60c7664cb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:38.572481 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-12f8bb1b-a191-47ac-a061-7fb60c7664cb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:38.572918 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-12f8bb1b-a191-47ac-a061-7fb60c7664cb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:38.573329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-12f8bb1b-a191-47ac-a061-7fb60c7664cb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:38.594721 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ae065243-d23e-4063-90ea-938c3dab53c2 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:38.596107 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ae065243-d23e-4063-90ea-938c3dab53c2 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:38.605336 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae065243-d23e-4063-90ea-938c3dab53c2 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:38.605336 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae065243-d23e-4063-90ea-938c3dab53c2 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:38.605336 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae065243-d23e-4063-90ea-938c3dab53c2 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:38.605336 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae065243-d23e-4063-90ea-938c3dab53c2 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:38.605641 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae065243-d23e-4063-90ea-938c3dab53c2 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:38.605641 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae065243-d23e-4063-90ea-938c3dab53c2 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:38.782813 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-12f8bb1b-a191-47ac-a061-7fb60c7664cb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:38.791658 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-12f8bb1b-a191-47ac-a061-7fb60c7664cb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.231468 Aug 22 05:40:38.792126 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 167/323] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:38 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:38.797665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-bc06ce25-b5a1-497d-9309-5a63c732e7b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:38.798326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-bc06ce25-b5a1-497d-9309-5a63c732e7b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:38.806583 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bc06ce25-b5a1-497d-9309-5a63c732e7b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:38.807169 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bc06ce25-b5a1-497d-9309-5a63c732e7b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:38.807703 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bc06ce25-b5a1-497d-9309-5a63c732e7b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:38.808624 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bc06ce25-b5a1-497d-9309-5a63c732e7b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:38.809460 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bc06ce25-b5a1-497d-9309-5a63c732e7b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:38.813840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bc06ce25-b5a1-497d-9309-5a63c732e7b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:38.817960 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ae065243-d23e-4063-90ea-938c3dab53c2 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:38.827755 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ae065243-d23e-4063-90ea-938c3dab53c2 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1314 microversion: 2.1 time: 0.237212 Aug 22 05:40:38.830933 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 157/324] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:38 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:38.996773 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-bc06ce25-b5a1-497d-9309-5a63c732e7b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:39.002117 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-bc06ce25-b5a1-497d-9309-5a63c732e7b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:39.004033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-bc06ce25-b5a1-497d-9309-5a63c732e7b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:39.005204 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-bc06ce25-b5a1-497d-9309-5a63c732e7b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1406 microversion: 2.20 time: 0.211590 Aug 22 05:40:39.005774 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 168/325] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:38 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:39.814428 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f84fd646-d010-4681-82b8-c3eb48f1bf52 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:39.815010 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f84fd646-d010-4681-82b8-c3eb48f1bf52 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:39.817035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:40:39.817911 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=6 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:40:39.822901 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f84fd646-d010-4681-82b8-c3eb48f1bf52 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:39.823636 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f84fd646-d010-4681-82b8-c3eb48f1bf52 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:39.824032 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f84fd646-d010-4681-82b8-c3eb48f1bf52 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:39.824795 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f84fd646-d010-4681-82b8-c3eb48f1bf52 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:39.825337 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f84fd646-d010-4681-82b8-c3eb48f1bf52 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:39.825912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f84fd646-d010-4681-82b8-c3eb48f1bf52 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:39.854129 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0efbca27-dbe7-4f57-8659-953d0a99e700 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:39.855403 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0efbca27-dbe7-4f57-8659-953d0a99e700 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:39.858682 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=2 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:40:39.859445 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=14 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:40:39.861965 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:40:39.906022 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0efbca27-dbe7-4f57-8659-953d0a99e700 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:39.906531 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0efbca27-dbe7-4f57-8659-953d0a99e700 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:39.909884 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0efbca27-dbe7-4f57-8659-953d0a99e700 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:39.910659 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0efbca27-dbe7-4f57-8659-953d0a99e700 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:39.911846 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0efbca27-dbe7-4f57-8659-953d0a99e700 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:39.912290 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0efbca27-dbe7-4f57-8659-953d0a99e700 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:40.208411 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f84fd646-d010-4681-82b8-c3eb48f1bf52 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:40.215432 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0efbca27-dbe7-4f57-8659-953d0a99e700 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:40.233431 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0efbca27-dbe7-4f57-8659-953d0a99e700 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1314 microversion: 2.1 time: 0.383523 Aug 22 05:40:40.234900 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f84fd646-d010-4681-82b8-c3eb48f1bf52 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.424348 Aug 22 05:40:40.238253 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 169/326] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:39 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:40.242965 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4e94b305-3249-4fd2-8168-6453ebbf0a3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:40.243394 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 158/327] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:39 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:40.253053 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4e94b305-3249-4fd2-8168-6453ebbf0a3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:40.260624 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4e94b305-3249-4fd2-8168-6453ebbf0a3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:40.261732 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4e94b305-3249-4fd2-8168-6453ebbf0a3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:40.262292 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4e94b305-3249-4fd2-8168-6453ebbf0a3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:40.263193 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4e94b305-3249-4fd2-8168-6453ebbf0a3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:40.263735 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4e94b305-3249-4fd2-8168-6453ebbf0a3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:40.264235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4e94b305-3249-4fd2-8168-6453ebbf0a3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:40.393295 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4e94b305-3249-4fd2-8168-6453ebbf0a3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:40.401727 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4e94b305-3249-4fd2-8168-6453ebbf0a3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:40.403274 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4e94b305-3249-4fd2-8168-6453ebbf0a3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:40.406903 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4e94b305-3249-4fd2-8168-6453ebbf0a3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1406 microversion: 2.20 time: 0.167623 Aug 22 05:40:40.407473 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 170/328] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:40 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:41.257860 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-cc717a2c-7f78-4e63-ba3d-614f3a06c607 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:41.258479 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-cc717a2c-7f78-4e63-ba3d-614f3a06c607 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:41.265195 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc717a2c-7f78-4e63-ba3d-614f3a06c607 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:41.265661 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc717a2c-7f78-4e63-ba3d-614f3a06c607 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:41.266340 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc717a2c-7f78-4e63-ba3d-614f3a06c607 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:41.267034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc717a2c-7f78-4e63-ba3d-614f3a06c607 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:41.267484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc717a2c-7f78-4e63-ba3d-614f3a06c607 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:41.267617 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a289f3ef-94fd-4108-9941-7d2600c50c4f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:41.268032 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc717a2c-7f78-4e63-ba3d-614f3a06c607 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:41.268166 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a289f3ef-94fd-4108-9941-7d2600c50c4f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:41.276724 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a289f3ef-94fd-4108-9941-7d2600c50c4f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:41.277277 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a289f3ef-94fd-4108-9941-7d2600c50c4f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:41.277811 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a289f3ef-94fd-4108-9941-7d2600c50c4f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:41.278662 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a289f3ef-94fd-4108-9941-7d2600c50c4f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:41.279131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a289f3ef-94fd-4108-9941-7d2600c50c4f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:41.279865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a289f3ef-94fd-4108-9941-7d2600c50c4f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:41.469138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-cc717a2c-7f78-4e63-ba3d-614f3a06c607 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:41.473276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a289f3ef-94fd-4108-9941-7d2600c50c4f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:41.477027 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-cc717a2c-7f78-4e63-ba3d-614f3a06c607 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.223010 Aug 22 05:40:41.477572 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 159/329] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:41 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:41.482129 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3174da81-8905-432a-9c6a-790b57252a31 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:41.482732 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3174da81-8905-432a-9c6a-790b57252a31 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:41.488739 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3174da81-8905-432a-9c6a-790b57252a31 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:41.489212 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3174da81-8905-432a-9c6a-790b57252a31 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:41.489869 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3174da81-8905-432a-9c6a-790b57252a31 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:41.490643 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3174da81-8905-432a-9c6a-790b57252a31 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:41.491138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3174da81-8905-432a-9c6a-790b57252a31 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:41.491611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3174da81-8905-432a-9c6a-790b57252a31 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:41.495940 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a289f3ef-94fd-4108-9941-7d2600c50c4f tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1314 microversion: 2.1 time: 0.232375 Aug 22 05:40:41.496533 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 171/330] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:41 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:41.621550 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3174da81-8905-432a-9c6a-790b57252a31 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:41.629908 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3174da81-8905-432a-9c6a-790b57252a31 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:41.631506 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3174da81-8905-432a-9c6a-790b57252a31 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:41.632754 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3174da81-8905-432a-9c6a-790b57252a31 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1406 microversion: 2.20 time: 0.154194 Aug 22 05:40:41.633378 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 160/331] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:41 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:42.511318 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-51160755-b638-4f07-ba69-ea82a3979381 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:42.511940 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-51160755-b638-4f07-ba69-ea82a3979381 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:42.517041 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9ff2f030-19dd-4801-804e-8a04313e8cef tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:42.517650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9ff2f030-19dd-4801-804e-8a04313e8cef tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:42.519003 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-51160755-b638-4f07-ba69-ea82a3979381 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:42.519491 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-51160755-b638-4f07-ba69-ea82a3979381 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:42.519944 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-51160755-b638-4f07-ba69-ea82a3979381 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:42.520632 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-51160755-b638-4f07-ba69-ea82a3979381 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:42.521075 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-51160755-b638-4f07-ba69-ea82a3979381 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:42.521619 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-51160755-b638-4f07-ba69-ea82a3979381 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:42.523692 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9ff2f030-19dd-4801-804e-8a04313e8cef tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:42.524363 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9ff2f030-19dd-4801-804e-8a04313e8cef tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:42.524805 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9ff2f030-19dd-4801-804e-8a04313e8cef tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:42.525528 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9ff2f030-19dd-4801-804e-8a04313e8cef tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:42.525969 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9ff2f030-19dd-4801-804e-8a04313e8cef tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:42.526426 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9ff2f030-19dd-4801-804e-8a04313e8cef tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:42.719254 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-51160755-b638-4f07-ba69-ea82a3979381 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:42.723099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9ff2f030-19dd-4801-804e-8a04313e8cef tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:42.727266 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-51160755-b638-4f07-ba69-ea82a3979381 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.219889 Aug 22 05:40:42.727874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 172/332] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:42 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:42.730675 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9ff2f030-19dd-4801-804e-8a04313e8cef tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1314 microversion: 2.1 time: 0.217870 Aug 22 05:40:42.731312 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 161/333] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:42 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:40:42.732671 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e530ff1e-5d56-457d-99f1-8bfd2c30a788 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:42.733251 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e530ff1e-5d56-457d-99f1-8bfd2c30a788 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:42.739167 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e530ff1e-5d56-457d-99f1-8bfd2c30a788 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:42.739739 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e530ff1e-5d56-457d-99f1-8bfd2c30a788 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:42.740182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e530ff1e-5d56-457d-99f1-8bfd2c30a788 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:42.740985 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e530ff1e-5d56-457d-99f1-8bfd2c30a788 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:42.741440 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e530ff1e-5d56-457d-99f1-8bfd2c30a788 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:42.741874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e530ff1e-5d56-457d-99f1-8bfd2c30a788 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:42.874533 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e530ff1e-5d56-457d-99f1-8bfd2c30a788 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:42.882988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e530ff1e-5d56-457d-99f1-8bfd2c30a788 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:42.884527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e530ff1e-5d56-457d-99f1-8bfd2c30a788 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:42.885641 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e530ff1e-5d56-457d-99f1-8bfd2c30a788 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1406 microversion: 2.20 time: 0.156833 Aug 22 05:40:42.886210 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 173/334] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:42 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:43.710531 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-ef952838-55bd-4970-87e4-33768b8cf57a req-cf6cab38-5bf9-44c5-83cd-59a78078a3ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aac67d5-bccb-4405-83fc-a0539b68e34a", "name": "network-vif-plugged", "status": "completed", "tag": "d0e3f633-f38e-4fad-9ba1-9b3eed69eb5a"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:40:43.736580 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-ef952838-55bd-4970-87e4-33768b8cf57a req-cf6cab38-5bf9-44c5-83cd-59a78078a3ae service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:43.737169 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-ef952838-55bd-4970-87e4-33768b8cf57a req-cf6cab38-5bf9-44c5-83cd-59a78078a3ae service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:43.737683 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-ef952838-55bd-4970-87e4-33768b8cf57a req-cf6cab38-5bf9-44c5-83cd-59a78078a3ae service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:43.740935 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:40:43.748854 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-80132917-3b07-4cb3-b613-8cd3b0bcb8d0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:43.749456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-80132917-3b07-4cb3-b613-8cd3b0bcb8d0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:43.756014 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-80132917-3b07-4cb3-b613-8cd3b0bcb8d0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:43.756759 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-80132917-3b07-4cb3-b613-8cd3b0bcb8d0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:43.757485 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-80132917-3b07-4cb3-b613-8cd3b0bcb8d0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:43.758177 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-80132917-3b07-4cb3-b613-8cd3b0bcb8d0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:43.758624 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-80132917-3b07-4cb3-b613-8cd3b0bcb8d0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:43.759039 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-80132917-3b07-4cb3-b613-8cd3b0bcb8d0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:43.764866 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-ef952838-55bd-4970-87e4-33768b8cf57a req-cf6cab38-5bf9-44c5-83cd-59a78078a3ae service nova] Creating event network-vif-plugged:d0e3f633-f38e-4fad-9ba1-9b3eed69eb5a for instance 0aac67d5-bccb-4405-83fc-a0539b68e34a on hv-cinder-85391 Aug 22 05:40:43.769931 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-ef952838-55bd-4970-87e4-33768b8cf57a req-cf6cab38-5bf9-44c5-83cd-59a78078a3ae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063020 Aug 22 05:40:43.770834 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 162/335] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:40:43.776450 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1464e8cb-105b-48b1-a21f-41a2ff447675 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:43.777117 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1464e8cb-105b-48b1-a21f-41a2ff447675 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:43.783911 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1464e8cb-105b-48b1-a21f-41a2ff447675 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:43.784383 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1464e8cb-105b-48b1-a21f-41a2ff447675 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:43.784994 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1464e8cb-105b-48b1-a21f-41a2ff447675 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:43.785684 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1464e8cb-105b-48b1-a21f-41a2ff447675 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:43.786117 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1464e8cb-105b-48b1-a21f-41a2ff447675 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:43.786695 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1464e8cb-105b-48b1-a21f-41a2ff447675 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:43.959965 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-80132917-3b07-4cb3-b613-8cd3b0bcb8d0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:43.966582 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1464e8cb-105b-48b1-a21f-41a2ff447675 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:43.968572 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-80132917-3b07-4cb3-b613-8cd3b0bcb8d0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.223608 Aug 22 05:40:43.969170 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 174/336] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:43 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:43.973759 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-44aeff2d-b3db-4ac0-af7b-0c50e512b6a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:43.974412 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-44aeff2d-b3db-4ac0-af7b-0c50e512b6a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:43.982616 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44aeff2d-b3db-4ac0-af7b-0c50e512b6a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:43.983105 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44aeff2d-b3db-4ac0-af7b-0c50e512b6a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:43.983710 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44aeff2d-b3db-4ac0-af7b-0c50e512b6a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:43.983906 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1464e8cb-105b-48b1-a21f-41a2ff447675 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1314 microversion: 2.1 time: 0.211613 Aug 22 05:40:43.984419 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44aeff2d-b3db-4ac0-af7b-0c50e512b6a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:43.984513 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 163/337] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:43 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:43.984868 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44aeff2d-b3db-4ac0-af7b-0c50e512b6a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:43.985292 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44aeff2d-b3db-4ac0-af7b-0c50e512b6a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:44.358361 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-44aeff2d-b3db-4ac0-af7b-0c50e512b6a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:44.366810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-44aeff2d-b3db-4ac0-af7b-0c50e512b6a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:44.368378 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-44aeff2d-b3db-4ac0-af7b-0c50e512b6a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:44.369500 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-44aeff2d-b3db-4ac0-af7b-0c50e512b6a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1406 microversion: 2.20 time: 0.399400 Aug 22 05:40:44.370014 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 175/338] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:43 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1406 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:44.990332 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e4962f66-0550-46ed-afa8-bbba87e31a5d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:44.990948 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e4962f66-0550-46ed-afa8-bbba87e31a5d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:44.997879 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e4962f66-0550-46ed-afa8-bbba87e31a5d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:44.998884 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e4962f66-0550-46ed-afa8-bbba87e31a5d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:44.999337 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e4962f66-0550-46ed-afa8-bbba87e31a5d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:45.000053 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e4962f66-0550-46ed-afa8-bbba87e31a5d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:45.000501 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e4962f66-0550-46ed-afa8-bbba87e31a5d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:45.000922 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e4962f66-0550-46ed-afa8-bbba87e31a5d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:45.005299 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0da3a8d0-4747-47ed-be4b-857ab0ba7d66 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:45.005884 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0da3a8d0-4747-47ed-be4b-857ab0ba7d66 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:45.012596 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0da3a8d0-4747-47ed-be4b-857ab0ba7d66 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:45.013084 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0da3a8d0-4747-47ed-be4b-857ab0ba7d66 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:45.013765 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0da3a8d0-4747-47ed-be4b-857ab0ba7d66 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:45.014468 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0da3a8d0-4747-47ed-be4b-857ab0ba7d66 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:45.014917 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0da3a8d0-4747-47ed-be4b-857ab0ba7d66 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:45.015338 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0da3a8d0-4747-47ed-be4b-857ab0ba7d66 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:45.202885 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e4962f66-0550-46ed-afa8-bbba87e31a5d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:45.210359 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0da3a8d0-4747-47ed-be4b-857ab0ba7d66 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:45.210868 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e4962f66-0550-46ed-afa8-bbba87e31a5d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.224463 Aug 22 05:40:45.211445 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 164/339] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:44 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:45.221195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0da3a8d0-4747-47ed-be4b-857ab0ba7d66 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1314 microversion: 2.1 time: 0.219769 Aug 22 05:40:45.230126 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 176/340] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:45 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:45.392675 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a9172c79-c874-4ae1-9941-32c3a346a357 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:45.393491 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a9172c79-c874-4ae1-9941-32c3a346a357 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:45.401317 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9172c79-c874-4ae1-9941-32c3a346a357 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:45.402040 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9172c79-c874-4ae1-9941-32c3a346a357 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:45.402883 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9172c79-c874-4ae1-9941-32c3a346a357 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:45.404111 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9172c79-c874-4ae1-9941-32c3a346a357 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:45.405043 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9172c79-c874-4ae1-9941-32c3a346a357 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:45.405689 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9172c79-c874-4ae1-9941-32c3a346a357 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:45.566381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a9172c79-c874-4ae1-9941-32c3a346a357 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:45.580618 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a9172c79-c874-4ae1-9941-32c3a346a357 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:45.582307 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a9172c79-c874-4ae1-9941-32c3a346a357 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:45.583609 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a9172c79-c874-4ae1-9941-32c3a346a357 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1406 microversion: 2.20 time: 0.195845 Aug 22 05:40:45.584246 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 165/341] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:45 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:46.234236 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-9fac4998-e323-4298-9a95-710ef959b173 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:46.234876 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-9fac4998-e323-4298-9a95-710ef959b173 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:46.245474 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1f1d0f7b-48ed-49c7-9652-57e8a81b864c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:46.246528 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9fac4998-e323-4298-9a95-710ef959b173 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:46.247543 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1f1d0f7b-48ed-49c7-9652-57e8a81b864c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:46.248043 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9fac4998-e323-4298-9a95-710ef959b173 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:46.248686 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9fac4998-e323-4298-9a95-710ef959b173 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:46.250149 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9fac4998-e323-4298-9a95-710ef959b173 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:46.250862 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9fac4998-e323-4298-9a95-710ef959b173 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:46.251485 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9fac4998-e323-4298-9a95-710ef959b173 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:46.262773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1f1d0f7b-48ed-49c7-9652-57e8a81b864c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:46.264244 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1f1d0f7b-48ed-49c7-9652-57e8a81b864c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:46.264695 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1f1d0f7b-48ed-49c7-9652-57e8a81b864c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:46.267139 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1f1d0f7b-48ed-49c7-9652-57e8a81b864c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:46.267627 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1f1d0f7b-48ed-49c7-9652-57e8a81b864c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:46.268054 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1f1d0f7b-48ed-49c7-9652-57e8a81b864c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:46.573396 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-9fac4998-e323-4298-9a95-710ef959b173 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:46.577508 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1f1d0f7b-48ed-49c7-9652-57e8a81b864c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:46.581345 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-9fac4998-e323-4298-9a95-710ef959b173 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.351615 Aug 22 05:40:46.581924 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 177/342] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:46 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:46.585148 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1f1d0f7b-48ed-49c7-9652-57e8a81b864c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1314 microversion: 2.1 time: 0.346446 Aug 22 05:40:46.585706 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 166/343] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:46 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:46.606274 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b96764f9-5563-471e-821f-28b28b659298 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:46.606988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b96764f9-5563-471e-821f-28b28b659298 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:46.613071 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b96764f9-5563-471e-821f-28b28b659298 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:46.613541 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b96764f9-5563-471e-821f-28b28b659298 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:46.614027 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b96764f9-5563-471e-821f-28b28b659298 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:46.614722 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b96764f9-5563-471e-821f-28b28b659298 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:46.615172 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b96764f9-5563-471e-821f-28b28b659298 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:46.615609 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b96764f9-5563-471e-821f-28b28b659298 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:46.756291 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b96764f9-5563-471e-821f-28b28b659298 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:46.764978 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b96764f9-5563-471e-821f-28b28b659298 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:46.766461 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b96764f9-5563-471e-821f-28b28b659298 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:46.767551 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b96764f9-5563-471e-821f-28b28b659298 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1406 microversion: 2.20 time: 0.165087 Aug 22 05:40:46.768347 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 178/344] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:46 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:47.602202 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4584cafe-d0eb-436d-9f35-2ec618c7482a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:47.603513 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4584cafe-d0eb-436d-9f35-2ec618c7482a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:47.605664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-fc01d8b4-63fc-44b1-ba1a-0cd8f6306263 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:47.606734 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-fc01d8b4-63fc-44b1-ba1a-0cd8f6306263 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:47.610880 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4584cafe-d0eb-436d-9f35-2ec618c7482a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:47.611389 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4584cafe-d0eb-436d-9f35-2ec618c7482a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:47.611845 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4584cafe-d0eb-436d-9f35-2ec618c7482a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:47.612545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4584cafe-d0eb-436d-9f35-2ec618c7482a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:47.612991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4584cafe-d0eb-436d-9f35-2ec618c7482a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:47.613409 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4584cafe-d0eb-436d-9f35-2ec618c7482a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:47.615042 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fc01d8b4-63fc-44b1-ba1a-0cd8f6306263 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:47.615744 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fc01d8b4-63fc-44b1-ba1a-0cd8f6306263 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:47.616139 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fc01d8b4-63fc-44b1-ba1a-0cd8f6306263 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:47.616991 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fc01d8b4-63fc-44b1-ba1a-0cd8f6306263 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:47.617856 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fc01d8b4-63fc-44b1-ba1a-0cd8f6306263 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:47.618245 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fc01d8b4-63fc-44b1-ba1a-0cd8f6306263 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:47.816440 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4584cafe-d0eb-436d-9f35-2ec618c7482a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:47.820905 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-fc01d8b4-63fc-44b1-ba1a-0cd8f6306263 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:47.824635 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=100 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:40:47.825238 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4584cafe-d0eb-436d-9f35-2ec618c7482a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.226744 Aug 22 05:40:47.827100 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 167/345] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:47 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:47.830267 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-fc01d8b4-63fc-44b1-ba1a-0cd8f6306263 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1314 microversion: 2.1 time: 0.228322 Aug 22 05:40:47.843598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-117f45b6-d149-467b-be7a-45a74899f1cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:47.843598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-117f45b6-d149-467b-be7a-45a74899f1cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:47.843598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-117f45b6-d149-467b-be7a-45a74899f1cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:47.843598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-117f45b6-d149-467b-be7a-45a74899f1cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:47.844017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-117f45b6-d149-467b-be7a-45a74899f1cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:47.844017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-117f45b6-d149-467b-be7a-45a74899f1cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:47.844017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-117f45b6-d149-467b-be7a-45a74899f1cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:47.844017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-117f45b6-d149-467b-be7a-45a74899f1cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:47.845605 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 179/346] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:47 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:40:47.972352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-117f45b6-d149-467b-be7a-45a74899f1cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:47.981164 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-117f45b6-d149-467b-be7a-45a74899f1cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:47.982763 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-117f45b6-d149-467b-be7a-45a74899f1cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:47.983849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-117f45b6-d149-467b-be7a-45a74899f1cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1406 microversion: 2.20 time: 0.155614 Aug 22 05:40:47.984434 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 168/347] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:47 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:48.850067 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b24a9837-ac21-437c-b40e-7f6fc26a5861 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:48.850658 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b24a9837-ac21-437c-b40e-7f6fc26a5861 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:48.853702 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-dd96a22a-dedc-400e-9eed-2c7cce0a6999 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:48.854737 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-dd96a22a-dedc-400e-9eed-2c7cce0a6999 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:48.858071 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b24a9837-ac21-437c-b40e-7f6fc26a5861 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:48.858557 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b24a9837-ac21-437c-b40e-7f6fc26a5861 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:48.858986 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b24a9837-ac21-437c-b40e-7f6fc26a5861 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:48.859701 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b24a9837-ac21-437c-b40e-7f6fc26a5861 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:48.860147 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b24a9837-ac21-437c-b40e-7f6fc26a5861 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:48.860561 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b24a9837-ac21-437c-b40e-7f6fc26a5861 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:48.860680 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd96a22a-dedc-400e-9eed-2c7cce0a6999 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:48.861089 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd96a22a-dedc-400e-9eed-2c7cce0a6999 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:48.861514 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd96a22a-dedc-400e-9eed-2c7cce0a6999 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:48.862344 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd96a22a-dedc-400e-9eed-2c7cce0a6999 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:48.862804 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd96a22a-dedc-400e-9eed-2c7cce0a6999 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:48.863222 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd96a22a-dedc-400e-9eed-2c7cce0a6999 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:49.089829 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b24a9837-ac21-437c-b40e-7f6fc26a5861 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:49.093949 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-dd96a22a-dedc-400e-9eed-2c7cce0a6999 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:49.102735 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b24a9837-ac21-437c-b40e-7f6fc26a5861 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.258034 Aug 22 05:40:49.103370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 180/348] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:48 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:49.103485 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-dd96a22a-dedc-400e-9eed-2c7cce0a6999 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1314 microversion: 2.1 time: 0.253879 Aug 22 05:40:49.104296 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 169/349] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:48 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:49.109546 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-17779a91-4903-4bbe-b873-6a817244e794 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:49.110150 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-17779a91-4903-4bbe-b873-6a817244e794 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:49.117384 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-17779a91-4903-4bbe-b873-6a817244e794 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:49.117860 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-17779a91-4903-4bbe-b873-6a817244e794 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:49.118283 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-17779a91-4903-4bbe-b873-6a817244e794 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:49.118973 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-17779a91-4903-4bbe-b873-6a817244e794 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:49.119405 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-17779a91-4903-4bbe-b873-6a817244e794 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:49.119897 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-17779a91-4903-4bbe-b873-6a817244e794 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:49.283058 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-17779a91-4903-4bbe-b873-6a817244e794 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:49.295477 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-17779a91-4903-4bbe-b873-6a817244e794 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:49.297136 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-17779a91-4903-4bbe-b873-6a817244e794 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:49.298235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-17779a91-4903-4bbe-b873-6a817244e794 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1406 microversion: 2.20 time: 0.193911 Aug 22 05:40:49.299024 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 181/350] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:49 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:50.057801 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-6529ad17-8cc1-41ec-9623-29f4b63b8bd3 req-1a6843de-a9f1-45fb-983a-f67d6b2e8ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb", "name": "network-vif-plugged", "status": "completed", "tag": "4c76faf8-d367-4a1e-9d06-cc6e666badde"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:40:50.069545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-6529ad17-8cc1-41ec-9623-29f4b63b8bd3 req-1a6843de-a9f1-45fb-983a-f67d6b2e8ec8 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:50.070026 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-6529ad17-8cc1-41ec-9623-29f4b63b8bd3 req-1a6843de-a9f1-45fb-983a-f67d6b2e8ec8 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:50.070455 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-6529ad17-8cc1-41ec-9623-29f4b63b8bd3 req-1a6843de-a9f1-45fb-983a-f67d6b2e8ec8 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:50.082266 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-6529ad17-8cc1-41ec-9623-29f4b63b8bd3 req-1a6843de-a9f1-45fb-983a-f67d6b2e8ec8 service nova] Creating event network-vif-plugged:4c76faf8-d367-4a1e-9d06-cc6e666badde for instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb on hv-cinder-85391 Aug 22 05:40:50.087251 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-6529ad17-8cc1-41ec-9623-29f4b63b8bd3 req-1a6843de-a9f1-45fb-983a-f67d6b2e8ec8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033191 Aug 22 05:40:50.087887 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 170/351] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:40:50.125746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-1422e9dc-3176-4719-92b0-f4349d9a05da tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:50.126975 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-1422e9dc-3176-4719-92b0-f4349d9a05da tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:50.132266 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4158c1d0-2847-44db-866c-da174914b9c8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:50.133186 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4158c1d0-2847-44db-866c-da174914b9c8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:50.134800 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1422e9dc-3176-4719-92b0-f4349d9a05da tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:50.135559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1422e9dc-3176-4719-92b0-f4349d9a05da tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:50.136057 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1422e9dc-3176-4719-92b0-f4349d9a05da tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:50.137078 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1422e9dc-3176-4719-92b0-f4349d9a05da tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:50.137512 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1422e9dc-3176-4719-92b0-f4349d9a05da tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:50.137938 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1422e9dc-3176-4719-92b0-f4349d9a05da tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:50.140886 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4158c1d0-2847-44db-866c-da174914b9c8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:50.141621 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4158c1d0-2847-44db-866c-da174914b9c8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:50.142534 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4158c1d0-2847-44db-866c-da174914b9c8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:50.143240 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4158c1d0-2847-44db-866c-da174914b9c8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:50.143724 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4158c1d0-2847-44db-866c-da174914b9c8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:50.144145 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4158c1d0-2847-44db-866c-da174914b9c8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:50.346198 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4158c1d0-2847-44db-866c-da174914b9c8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:50.349598 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-1422e9dc-3176-4719-92b0-f4349d9a05da tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:50.355903 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4158c1d0-2847-44db-866c-da174914b9c8 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.228616 Aug 22 05:40:50.356464 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 171/352] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:50 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:50.357875 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-1422e9dc-3176-4719-92b0-f4349d9a05da tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1499 microversion: 2.1 time: 0.236015 Aug 22 05:40:50.358596 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 182/353] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:50 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1499 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:50.361095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-90996847-ccef-4a9d-8c86-8463e70e9e73 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:50.361713 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-90996847-ccef-4a9d-8c86-8463e70e9e73 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:50.367807 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90996847-ccef-4a9d-8c86-8463e70e9e73 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:50.368277 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90996847-ccef-4a9d-8c86-8463e70e9e73 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:50.368701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90996847-ccef-4a9d-8c86-8463e70e9e73 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:50.369483 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90996847-ccef-4a9d-8c86-8463e70e9e73 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:50.369921 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90996847-ccef-4a9d-8c86-8463e70e9e73 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:50.370329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90996847-ccef-4a9d-8c86-8463e70e9e73 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:50.526726 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-90996847-ccef-4a9d-8c86-8463e70e9e73 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:50.535662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-90996847-ccef-4a9d-8c86-8463e70e9e73 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:50.537014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-90996847-ccef-4a9d-8c86-8463e70e9e73 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:50.538099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-90996847-ccef-4a9d-8c86-8463e70e9e73 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1406 microversion: 2.20 time: 0.180734 Aug 22 05:40:50.538824 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 172/354] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:50 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:50.827744 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8b9c2857-88c4-4e51-b8db-e7eb45f85319 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:50.828246 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8b9c2857-88c4-4e51-b8db-e7eb45f85319 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:50.834556 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b9c2857-88c4-4e51-b8db-e7eb45f85319 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:50.835049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b9c2857-88c4-4e51-b8db-e7eb45f85319 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:50.835757 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b9c2857-88c4-4e51-b8db-e7eb45f85319 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:50.836450 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b9c2857-88c4-4e51-b8db-e7eb45f85319 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:50.836990 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b9c2857-88c4-4e51-b8db-e7eb45f85319 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:50.837543 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b9c2857-88c4-4e51-b8db-e7eb45f85319 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:50.863390 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8b9c2857-88c4-4e51-b8db-e7eb45f85319 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Going to try to terminate instance {{(pid=132497) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:40:50.954118 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8b9c2857-88c4-4e51-b8db-e7eb45f85319 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 204 len: 0 microversion: 2.1 time: 0.130115 Aug 22 05:40:50.954753 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 183/355] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:40:50 2022] DELETE /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:40:50.963425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c9f9e6b5-3f31-4f78-9692-72e8ee4f8154 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:50.964064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c9f9e6b5-3f31-4f78-9692-72e8ee4f8154 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:50.970582 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9f9e6b5-3f31-4f78-9692-72e8ee4f8154 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:50.971066 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9f9e6b5-3f31-4f78-9692-72e8ee4f8154 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:50.971499 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9f9e6b5-3f31-4f78-9692-72e8ee4f8154 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:50.972245 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9f9e6b5-3f31-4f78-9692-72e8ee4f8154 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:50.972691 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9f9e6b5-3f31-4f78-9692-72e8ee4f8154 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:50.973108 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9f9e6b5-3f31-4f78-9692-72e8ee4f8154 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:51.103774 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c9f9e6b5-3f31-4f78-9692-72e8ee4f8154 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:51.112264 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c9f9e6b5-3f31-4f78-9692-72e8ee4f8154 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1505 microversion: 2.1 time: 0.152519 Aug 22 05:40:51.112843 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 173/356] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:50 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:51.383819 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b8365643-a436-42ac-b1d6-aaee860e1e90 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:51.385269 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b8365643-a436-42ac-b1d6-aaee860e1e90 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:51.396847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b8365643-a436-42ac-b1d6-aaee860e1e90 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:51.397636 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b8365643-a436-42ac-b1d6-aaee860e1e90 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:51.398341 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b8365643-a436-42ac-b1d6-aaee860e1e90 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:51.399645 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b8365643-a436-42ac-b1d6-aaee860e1e90 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:51.400387 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b8365643-a436-42ac-b1d6-aaee860e1e90 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:51.401074 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b8365643-a436-42ac-b1d6-aaee860e1e90 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:51.545468 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b8365643-a436-42ac-b1d6-aaee860e1e90 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:51.555712 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b8365643-a436-42ac-b1d6-aaee860e1e90 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.180318 Aug 22 05:40:51.556294 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 184/357] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:51 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:51.561189 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1a3ded5c-2611-49d2-8d1a-7000999f3e9a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:51.561850 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1a3ded5c-2611-49d2-8d1a-7000999f3e9a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:51.568134 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1a3ded5c-2611-49d2-8d1a-7000999f3e9a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:51.568606 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1a3ded5c-2611-49d2-8d1a-7000999f3e9a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:51.569027 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1a3ded5c-2611-49d2-8d1a-7000999f3e9a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:51.569700 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1a3ded5c-2611-49d2-8d1a-7000999f3e9a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:51.570139 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1a3ded5c-2611-49d2-8d1a-7000999f3e9a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:51.570549 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1a3ded5c-2611-49d2-8d1a-7000999f3e9a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:51.702103 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1a3ded5c-2611-49d2-8d1a-7000999f3e9a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:51.716720 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1a3ded5c-2611-49d2-8d1a-7000999f3e9a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:51.721296 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1a3ded5c-2611-49d2-8d1a-7000999f3e9a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:51.722914 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1a3ded5c-2611-49d2-8d1a-7000999f3e9a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1406 microversion: 2.20 time: 0.165526 Aug 22 05:40:51.723713 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 174/358] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:51 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:52.134148 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b2468447-705f-4c25-bda2-9dc2e86bff56 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:52.134751 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b2468447-705f-4c25-bda2-9dc2e86bff56 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:52.141137 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b2468447-705f-4c25-bda2-9dc2e86bff56 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:52.141607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b2468447-705f-4c25-bda2-9dc2e86bff56 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:52.142036 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b2468447-705f-4c25-bda2-9dc2e86bff56 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:52.142722 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b2468447-705f-4c25-bda2-9dc2e86bff56 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:52.143167 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b2468447-705f-4c25-bda2-9dc2e86bff56 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:52.143603 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b2468447-705f-4c25-bda2-9dc2e86bff56 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:52.272454 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b2468447-705f-4c25-bda2-9dc2e86bff56 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:52.280487 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b2468447-705f-4c25-bda2-9dc2e86bff56 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1505 microversion: 2.1 time: 0.150252 Aug 22 05:40:52.281060 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 185/359] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:52 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:52.576229 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-421ad194-f3a9-41eb-8f1f-3ad7f1c9f919 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:52.576897 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-421ad194-f3a9-41eb-8f1f-3ad7f1c9f919 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:52.578880 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:40:52.587340 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-421ad194-f3a9-41eb-8f1f-3ad7f1c9f919 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:52.587860 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-421ad194-f3a9-41eb-8f1f-3ad7f1c9f919 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:52.588290 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-421ad194-f3a9-41eb-8f1f-3ad7f1c9f919 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:52.588977 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-421ad194-f3a9-41eb-8f1f-3ad7f1c9f919 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:52.589420 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-421ad194-f3a9-41eb-8f1f-3ad7f1c9f919 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:52.589882 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-421ad194-f3a9-41eb-8f1f-3ad7f1c9f919 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:52.725111 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-421ad194-f3a9-41eb-8f1f-3ad7f1c9f919 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:52.733484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-421ad194-f3a9-41eb-8f1f-3ad7f1c9f919 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.161206 Aug 22 05:40:52.734107 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 175/360] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:52 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:52.747793 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-9c6be4a2-fd8d-4d1d-b5fb-37ea2479ebee tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:52.748569 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-9c6be4a2-fd8d-4d1d-b5fb-37ea2479ebee tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:52.755074 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9c6be4a2-fd8d-4d1d-b5fb-37ea2479ebee tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:52.755555 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9c6be4a2-fd8d-4d1d-b5fb-37ea2479ebee tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:52.756014 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9c6be4a2-fd8d-4d1d-b5fb-37ea2479ebee tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:52.756758 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9c6be4a2-fd8d-4d1d-b5fb-37ea2479ebee tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:52.757302 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9c6be4a2-fd8d-4d1d-b5fb-37ea2479ebee tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:52.757821 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9c6be4a2-fd8d-4d1d-b5fb-37ea2479ebee tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:52.891866 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-9c6be4a2-fd8d-4d1d-b5fb-37ea2479ebee tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:52.900295 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-9c6be4a2-fd8d-4d1d-b5fb-37ea2479ebee tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:52.901788 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-9c6be4a2-fd8d-4d1d-b5fb-37ea2479ebee tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:52.903401 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-9c6be4a2-fd8d-4d1d-b5fb-37ea2479ebee tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1406 microversion: 2.20 time: 0.159594 Aug 22 05:40:52.904048 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 186/361] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:52 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:53.303260 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-de663203-58d8-4bd2-8079-a38562276fb8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:53.303948 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-de663203-58d8-4bd2-8079-a38562276fb8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:53.310397 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de663203-58d8-4bd2-8079-a38562276fb8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:53.310989 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de663203-58d8-4bd2-8079-a38562276fb8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:53.311820 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de663203-58d8-4bd2-8079-a38562276fb8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:53.312646 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de663203-58d8-4bd2-8079-a38562276fb8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:53.313097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de663203-58d8-4bd2-8079-a38562276fb8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:53.313514 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de663203-58d8-4bd2-8079-a38562276fb8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:53.454645 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-de663203-58d8-4bd2-8079-a38562276fb8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:53.468882 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-de663203-58d8-4bd2-8079-a38562276fb8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1505 microversion: 2.1 time: 0.169875 Aug 22 05:40:53.470155 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 176/362] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:53 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:53.712525 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-fe77a584-17e8-4570-b004-3d0cfad7d3d7 req-add3cf32-19a5-44df-84c9-ba0a4fbe93b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aac67d5-bccb-4405-83fc-a0539b68e34a", "name": "network-vif-deleted", "tag": "d0e3f633-f38e-4fad-9ba1-9b3eed69eb5a"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:40:53.730990 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-fe77a584-17e8-4570-b004-3d0cfad7d3d7 req-add3cf32-19a5-44df-84c9-ba0a4fbe93b2 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:53.731480 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-fe77a584-17e8-4570-b004-3d0cfad7d3d7 req-add3cf32-19a5-44df-84c9-ba0a4fbe93b2 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:53.731928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-fe77a584-17e8-4570-b004-3d0cfad7d3d7 req-add3cf32-19a5-44df-84c9-ba0a4fbe93b2 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:53.743601 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-fe77a584-17e8-4570-b004-3d0cfad7d3d7 req-add3cf32-19a5-44df-84c9-ba0a4fbe93b2 service nova] Creating event network-vif-deleted:d0e3f633-f38e-4fad-9ba1-9b3eed69eb5a for instance 0aac67d5-bccb-4405-83fc-a0539b68e34a on hv-cinder-85391 Aug 22 05:40:53.748840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-fe77a584-17e8-4570-b004-3d0cfad7d3d7 req-add3cf32-19a5-44df-84c9-ba0a4fbe93b2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040378 Aug 22 05:40:53.752481 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 187/363] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:40:53.754901 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-532abcfb-00ec-4d5d-882d-d9dcfd43dc42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:53.755459 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-532abcfb-00ec-4d5d-882d-d9dcfd43dc42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:53.761783 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-532abcfb-00ec-4d5d-882d-d9dcfd43dc42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:53.762277 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-532abcfb-00ec-4d5d-882d-d9dcfd43dc42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:53.762684 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-532abcfb-00ec-4d5d-882d-d9dcfd43dc42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:53.763365 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-532abcfb-00ec-4d5d-882d-d9dcfd43dc42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:53.764163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-532abcfb-00ec-4d5d-882d-d9dcfd43dc42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:53.764592 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-532abcfb-00ec-4d5d-882d-d9dcfd43dc42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:53.895919 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-532abcfb-00ec-4d5d-882d-d9dcfd43dc42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:53.904149 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-532abcfb-00ec-4d5d-882d-d9dcfd43dc42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.153102 Aug 22 05:40:53.905365 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 177/364] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:53 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:53.927749 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e9906cba-de19-4996-a961-b624643d5fa1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:53.928418 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e9906cba-de19-4996-a961-b624643d5fa1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:53.934663 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e9906cba-de19-4996-a961-b624643d5fa1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:53.935138 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e9906cba-de19-4996-a961-b624643d5fa1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:53.935628 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e9906cba-de19-4996-a961-b624643d5fa1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:53.936290 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e9906cba-de19-4996-a961-b624643d5fa1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:53.936715 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e9906cba-de19-4996-a961-b624643d5fa1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:53.937125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e9906cba-de19-4996-a961-b624643d5fa1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:54.077705 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e9906cba-de19-4996-a961-b624643d5fa1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:54.086194 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e9906cba-de19-4996-a961-b624643d5fa1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:54.087814 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e9906cba-de19-4996-a961-b624643d5fa1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:54.088992 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e9906cba-de19-4996-a961-b624643d5fa1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1597 microversion: 2.20 time: 0.166227 Aug 22 05:40:54.089623 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 188/365] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:40:53 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1597 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:40:54.113079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3af90160-ffb5-48ca-9900-4b976cdf9c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:54.113756 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3af90160-ffb5-48ca-9900-4b976cdf9c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:54.120045 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3af90160-ffb5-48ca-9900-4b976cdf9c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:54.120614 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3af90160-ffb5-48ca-9900-4b976cdf9c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:54.121112 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3af90160-ffb5-48ca-9900-4b976cdf9c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:54.121869 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3af90160-ffb5-48ca-9900-4b976cdf9c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:54.122383 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3af90160-ffb5-48ca-9900-4b976cdf9c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:54.122799 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3af90160-ffb5-48ca-9900-4b976cdf9c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:54.208392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3af90160-ffb5-48ca-9900-4b976cdf9c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099457 Aug 22 05:40:54.209261 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 178/366] 10.222.0.18 () {60 vars in 1316 bytes} [Mon Aug 22 05:40:54 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:40:54.494311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-69576e0e-9e47-4e69-82b5-85d330700144 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:54.494935 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-69576e0e-9e47-4e69-82b5-85d330700144 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:54.503723 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-69576e0e-9e47-4e69-82b5-85d330700144 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:54.504290 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-69576e0e-9e47-4e69-82b5-85d330700144 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:54.504816 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-69576e0e-9e47-4e69-82b5-85d330700144 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:54.517559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-69576e0e-9e47-4e69-82b5-85d330700144 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:54.523446 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-69576e0e-9e47-4e69-82b5-85d330700144 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:54.523927 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-69576e0e-9e47-4e69-82b5-85d330700144 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:54.610546 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-69576e0e-9e47-4e69-82b5-85d330700144 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:54.611612 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-69576e0e-9e47-4e69-82b5-85d330700144 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:54.612066 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-69576e0e-9e47-4e69-82b5-85d330700144 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:54.612513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.objects.instance [None req-69576e0e-9e47-4e69-82b5-85d330700144 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lazy-loading 'fault' on Instance uuid 0aac67d5-bccb-4405-83fc-a0539b68e34a {{(pid=132497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:40:54.677582 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-69576e0e-9e47-4e69-82b5-85d330700144 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:54.685018 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-69576e0e-9e47-4e69-82b5-85d330700144 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 200 len: 1304 microversion: 2.1 time: 0.195707 Aug 22 05:40:54.687712 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 189/367] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:54 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 1304 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:54.930552 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-327cf3be-23d2-4832-bc30-7316c50ea886 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:54.931744 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-327cf3be-23d2-4832-bc30-7316c50ea886 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:54.938739 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-327cf3be-23d2-4832-bc30-7316c50ea886 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:54.939427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-327cf3be-23d2-4832-bc30-7316c50ea886 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:54.941079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-327cf3be-23d2-4832-bc30-7316c50ea886 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:54.941964 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-327cf3be-23d2-4832-bc30-7316c50ea886 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:54.942567 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-327cf3be-23d2-4832-bc30-7316c50ea886 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:54.943407 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-327cf3be-23d2-4832-bc30-7316c50ea886 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:55.153989 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-327cf3be-23d2-4832-bc30-7316c50ea886 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:55.162281 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-327cf3be-23d2-4832-bc30-7316c50ea886 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.237711 Aug 22 05:40:55.178152 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 179/368] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:54 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:55.708489 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7f64c220-8229-4641-9dfc-159acc4a1358 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:55.709098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-7f64c220-8229-4641-9dfc-159acc4a1358 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: 0aac67d5-bccb-4405-83fc-a0539b68e34a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:55.716438 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7f64c220-8229-4641-9dfc-159acc4a1358 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:55.717396 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7f64c220-8229-4641-9dfc-159acc4a1358 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:55.717829 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7f64c220-8229-4641-9dfc-159acc4a1358 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:55.718712 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7f64c220-8229-4641-9dfc-159acc4a1358 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:55.719310 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7f64c220-8229-4641-9dfc-159acc4a1358 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:55.719816 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7f64c220-8229-4641-9dfc-159acc4a1358 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:55.737322 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-7f64c220-8229-4641-9dfc-159acc4a1358 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] HTTP exception thrown: Instance 0aac67d5-bccb-4405-83fc-a0539b68e34a could not be found. Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7f64c220-8229-4641-9dfc-159acc4a1358 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Request method failure captured: Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a HTTP/1.1 Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxbDWMY-c24Iqiivl9eknkNZ2S10LEeOXG8ML0Ne4AGVQsLDDTtF3d-a4sI-aRpjpA9_CYLw5b88HQH1Kr7aGldtx9b-5sVaozc0DCOSw8aPJiLA9UaO9DW25sjLay7yHSeysiSfTGDelVQ37A-tTDaWiTAAP3DvbgIpxjJqSCKVnXQ Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: 375a7cf8cbc042a187f2b144d907c175 Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-VolumesActionsTest-669076233 Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:40:55.738988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:40:55.740599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_375a7cf8cbc042a187f2b144d907c175", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/375a7cf8cbc042a187f2b144d907c175"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/375a7cf8cbc042a187f2b144d907c175"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/375a7cf8cbc042a187f2b144d907c175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:40:55.740599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-VolumesActionsTest-669076233 Aug 22 05:40:55.740599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: 375a7cf8cbc042a187f2b144d907c175 Aug 22 05:40:55.740599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-VolumesActionsTest-669076233 Aug 22 05:40:55.740599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-VolumesActionsTest-669076233-project Aug 22 05:40:55.740599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:40:55.740599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:40:55.740599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: bf99219df4fb45a4b7ec5fea537f8be2 Aug 22 05:40:55.740599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-VolumesActionsTest-669076233-project Aug 22 05:40:55.740599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:40:55.740599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance 0aac67d5-bccb-4405-83fc-a0539b68e34a could not be found. Aug 22 05:40:55.740599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': '0aac67d5-bccb-4405-83fc-a0539b68e34a'} Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aac67d5-bccb-4405-83fc-a0539b68e34a could not be found. Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:40:55.741507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aac67d5-bccb-4405-83fc-a0539b68e34a could not be found. Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aac67d5-bccb-4405-83fc-a0539b68e34a could not be found. Aug 22 05:40:55.743028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:40:55.744676 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7f64c220-8229-4641-9dfc-159acc4a1358 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Returning 404 to user: Instance 0aac67d5-bccb-4405-83fc-a0539b68e34a could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:40:55.744676 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-7f64c220-8229-4641-9dfc-159acc4a1358 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a" status: 404 len: 111 microversion: 2.1 time: 0.035836 Aug 22 05:40:55.744676 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 190/369] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:55 2022] GET /compute/v2.1/servers/0aac67d5-bccb-4405-83fc-a0539b68e34a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 05:40:55.765324 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-5032b7ca-f199-41f4-a82f-8a16dffc5ac1 req-05036966-f240-4a39-a018-e8bb49c40813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb", "tag": "4c76faf8-d367-4a1e-9d06-cc6e666badde"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:40:55.778829 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-5032b7ca-f199-41f4-a82f-8a16dffc5ac1 req-05036966-f240-4a39-a018-e8bb49c40813 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:55.781255 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-5032b7ca-f199-41f4-a82f-8a16dffc5ac1 req-05036966-f240-4a39-a018-e8bb49c40813 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:55.781858 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-5032b7ca-f199-41f4-a82f-8a16dffc5ac1 req-05036966-f240-4a39-a018-e8bb49c40813 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:55.795282 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-5032b7ca-f199-41f4-a82f-8a16dffc5ac1 req-05036966-f240-4a39-a018-e8bb49c40813 service nova] Creating event network-changed:4c76faf8-d367-4a1e-9d06-cc6e666badde for instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb on hv-cinder-85391 Aug 22 05:40:55.802536 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-5032b7ca-f199-41f4-a82f-8a16dffc5ac1 req-05036966-f240-4a39-a018-e8bb49c40813 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042669 Aug 22 05:40:55.803300 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 180/370] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:40:55.856780 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-976211370", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452", "networks": [{"uuid": "8f1e16bf-0f88-4299-8ce3-c3baf34be992"}]}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:40:55.927940 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.network.neutron [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] validate_networks() for [('8f1e16bf-0f88-4299-8ce3-c3baf34be992', None, None, None, None, None)] {{(pid=132497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:40:56.190180 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7033c228-97ac-43fd-aee8-c1287a43cae7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:56.191709 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7033c228-97ac-43fd-aee8-c1287a43cae7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:56.199157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7033c228-97ac-43fd-aee8-c1287a43cae7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:56.199975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7033c228-97ac-43fd-aee8-c1287a43cae7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:56.200452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7033c228-97ac-43fd-aee8-c1287a43cae7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:56.202434 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7033c228-97ac-43fd-aee8-c1287a43cae7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:56.202862 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7033c228-97ac-43fd-aee8-c1287a43cae7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:56.203603 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7033c228-97ac-43fd-aee8-c1287a43cae7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:56.209117 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:40:56.520003 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7033c228-97ac-43fd-aee8-c1287a43cae7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:56.527905 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7033c228-97ac-43fd-aee8-c1287a43cae7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.342638 Aug 22 05:40:56.528455 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 181/371] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:56 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:56.553481 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Flavor limits 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:40:56.554144 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Image limits 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:40:56.554592 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Flavor pref 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:40:56.555051 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Image pref 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:40:56.555720 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:40:56.564945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:56.565417 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:56.565894 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:56.566806 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:56.567250 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:56.567700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:56.585863 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Getting quotas for project 375a7cf8cbc042a187f2b144d907c175. Resources: {'cores', 'instances', 'ram'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:40:56.590533 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Getting quotas for user bf99219df4fb45a4b7ec5fea537f8be2 and project 375a7cf8cbc042a187f2b144d907c175. Resources: {'cores', 'instances', 'ram'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:40:56.607136 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Going to run 1 instances... {{(pid=132497) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:40:56.609522 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:40:56.673774 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ac7ceb99-2c0b-4da9-b83c-cf5ab109dfc4 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820888 Aug 22 05:40:56.681996 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 191/372] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:40:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 05:40:56.695249 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a250aec3-63e8-4512-8121-e89b2b8c2bba tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:56.696351 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a250aec3-63e8-4512-8121-e89b2b8c2bba tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:56.754968 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a250aec3-63e8-4512-8121-e89b2b8c2bba tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:56.766724 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a250aec3-63e8-4512-8121-e89b2b8c2bba tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1213 microversion: 2.1 time: 0.075290 Aug 22 05:40:56.767563 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 182/373] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:56 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:57.551384 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6ff655ee-1b76-4363-ad29-1169e896a159 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:57.552908 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-6ff655ee-1b76-4363-ad29-1169e896a159 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:57.562789 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6ff655ee-1b76-4363-ad29-1169e896a159 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:57.563363 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6ff655ee-1b76-4363-ad29-1169e896a159 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:57.564029 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6ff655ee-1b76-4363-ad29-1169e896a159 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:57.565110 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6ff655ee-1b76-4363-ad29-1169e896a159 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:57.565564 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6ff655ee-1b76-4363-ad29-1169e896a159 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:57.566140 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6ff655ee-1b76-4363-ad29-1169e896a159 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:57.729225 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6ff655ee-1b76-4363-ad29-1169e896a159 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:57.743675 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6ff655ee-1b76-4363-ad29-1169e896a159 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.197424 Aug 22 05:40:57.745156 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 192/374] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:57 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:57.791797 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-dfd462be-63f0-45b6-b70b-42ac546145fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:57.792407 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-dfd462be-63f0-45b6-b70b-42ac546145fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:57.799382 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dfd462be-63f0-45b6-b70b-42ac546145fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:57.799906 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dfd462be-63f0-45b6-b70b-42ac546145fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:57.800339 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dfd462be-63f0-45b6-b70b-42ac546145fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:57.801048 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dfd462be-63f0-45b6-b70b-42ac546145fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:57.801494 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dfd462be-63f0-45b6-b70b-42ac546145fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:57.801912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dfd462be-63f0-45b6-b70b-42ac546145fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:57.890676 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-dfd462be-63f0-45b6-b70b-42ac546145fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:57.904041 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-dfd462be-63f0-45b6-b70b-42ac546145fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1217 microversion: 2.1 time: 0.115240 Aug 22 05:40:57.905552 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 183/375] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:57 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:58.766623 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-002bf3d1-9c1d-4723-8dc6-ca4c1cffc627 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:58.768391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-002bf3d1-9c1d-4723-8dc6-ca4c1cffc627 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:58.775970 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-002bf3d1-9c1d-4723-8dc6-ca4c1cffc627 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:58.776065 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-002bf3d1-9c1d-4723-8dc6-ca4c1cffc627 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:58.776552 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-002bf3d1-9c1d-4723-8dc6-ca4c1cffc627 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:58.777559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-002bf3d1-9c1d-4723-8dc6-ca4c1cffc627 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:58.778231 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-002bf3d1-9c1d-4723-8dc6-ca4c1cffc627 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:58.778713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-002bf3d1-9c1d-4723-8dc6-ca4c1cffc627 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:58.927216 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-836cd809-2090-438c-9bcf-05339b704273 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:58.928528 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-836cd809-2090-438c-9bcf-05339b704273 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:58.935030 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-836cd809-2090-438c-9bcf-05339b704273 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:58.936146 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-836cd809-2090-438c-9bcf-05339b704273 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:58.936856 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-836cd809-2090-438c-9bcf-05339b704273 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:58.937562 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-836cd809-2090-438c-9bcf-05339b704273 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:58.938171 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-836cd809-2090-438c-9bcf-05339b704273 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:58.938753 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-836cd809-2090-438c-9bcf-05339b704273 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:58.941654 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-002bf3d1-9c1d-4723-8dc6-ca4c1cffc627 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:58.954475 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-002bf3d1-9c1d-4723-8dc6-ca4c1cffc627 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.191995 Aug 22 05:40:58.960530 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 193/376] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:58 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:40:59.013817 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-836cd809-2090-438c-9bcf-05339b704273 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:40:59.023131 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-836cd809-2090-438c-9bcf-05339b704273 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1217 microversion: 2.1 time: 0.100080 Aug 22 05:40:59.024082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 184/377] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:58 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:40:59.976993 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-846fbb35-1ee0-45c7-a937-736b7558658e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:40:59.977732 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-846fbb35-1ee0-45c7-a937-736b7558658e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:40:59.984961 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-846fbb35-1ee0-45c7-a937-736b7558658e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:59.985563 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-846fbb35-1ee0-45c7-a937-736b7558658e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:59.986112 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-846fbb35-1ee0-45c7-a937-736b7558658e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:40:59.986865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-846fbb35-1ee0-45c7-a937-736b7558658e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:40:59.987531 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-846fbb35-1ee0-45c7-a937-736b7558658e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:40:59.988340 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-846fbb35-1ee0-45c7-a937-736b7558658e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:00.046533 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3ab2c5f0-e6d8-4639-9ca5-fa049269b6c6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:00.047807 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3ab2c5f0-e6d8-4639-9ca5-fa049269b6c6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:00.059449 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ab2c5f0-e6d8-4639-9ca5-fa049269b6c6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:00.059968 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ab2c5f0-e6d8-4639-9ca5-fa049269b6c6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:00.060651 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ab2c5f0-e6d8-4639-9ca5-fa049269b6c6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:00.063707 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ab2c5f0-e6d8-4639-9ca5-fa049269b6c6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:00.064358 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ab2c5f0-e6d8-4639-9ca5-fa049269b6c6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:00.064960 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ab2c5f0-e6d8-4639-9ca5-fa049269b6c6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:00.207451 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3ab2c5f0-e6d8-4639-9ca5-fa049269b6c6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:00.213157 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-846fbb35-1ee0-45c7-a937-736b7558658e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:00.219413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3ab2c5f0-e6d8-4639-9ca5-fa049269b6c6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1265 microversion: 2.1 time: 0.179092 Aug 22 05:41:00.220266 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 185/378] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:00 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:00.222977 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-846fbb35-1ee0-45c7-a937-736b7558658e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.249840 Aug 22 05:41:00.227421 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 194/379] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:40:59 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:01.241588 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8f6fb6e0-b4c6-427d-8e19-471788ab21db tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:01.242217 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8f6fb6e0-b4c6-427d-8e19-471788ab21db tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:01.247839 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-09764b66-ba74-4d93-a840-0dabbfbca152 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:01.249385 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-09764b66-ba74-4d93-a840-0dabbfbca152 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:01.258646 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f6fb6e0-b4c6-427d-8e19-471788ab21db tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:01.259156 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f6fb6e0-b4c6-427d-8e19-471788ab21db tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:01.259321 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-09764b66-ba74-4d93-a840-0dabbfbca152 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:01.259595 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f6fb6e0-b4c6-427d-8e19-471788ab21db tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:01.260180 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-09764b66-ba74-4d93-a840-0dabbfbca152 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:01.260335 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f6fb6e0-b4c6-427d-8e19-471788ab21db tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:01.260607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-09764b66-ba74-4d93-a840-0dabbfbca152 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:01.260720 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f6fb6e0-b4c6-427d-8e19-471788ab21db tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:01.261136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f6fb6e0-b4c6-427d-8e19-471788ab21db tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:01.261309 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-09764b66-ba74-4d93-a840-0dabbfbca152 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:01.261919 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-09764b66-ba74-4d93-a840-0dabbfbca152 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:01.262332 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-09764b66-ba74-4d93-a840-0dabbfbca152 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:01.372746 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8f6fb6e0-b4c6-427d-8e19-471788ab21db tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:01.385673 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8f6fb6e0-b4c6-427d-8e19-471788ab21db tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1273 microversion: 2.1 time: 0.146012 Aug 22 05:41:01.395609 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 186/380] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:01 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:01.497214 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-09764b66-ba74-4d93-a840-0dabbfbca152 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:01.505962 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-09764b66-ba74-4d93-a840-0dabbfbca152 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.262048 Aug 22 05:41:01.506735 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 195/381] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:01 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:02.413406 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a060a0b0-416f-406c-9c81-17af3ee3c9cf tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:02.414022 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a060a0b0-416f-406c-9c81-17af3ee3c9cf tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:02.420280 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a060a0b0-416f-406c-9c81-17af3ee3c9cf tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:02.420763 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a060a0b0-416f-406c-9c81-17af3ee3c9cf tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:02.421188 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a060a0b0-416f-406c-9c81-17af3ee3c9cf tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:02.421876 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a060a0b0-416f-406c-9c81-17af3ee3c9cf tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:02.422320 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a060a0b0-416f-406c-9c81-17af3ee3c9cf tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:02.423792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a060a0b0-416f-406c-9c81-17af3ee3c9cf tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:02.531809 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a060a0b0-416f-406c-9c81-17af3ee3c9cf tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:02.532958 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a9420653-90db-4ed8-b239-eaa384706c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:02.533620 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a9420653-90db-4ed8-b239-eaa384706c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:02.545870 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a060a0b0-416f-406c-9c81-17af3ee3c9cf tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1283 microversion: 2.1 time: 0.140474 Aug 22 05:41:02.546201 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a9420653-90db-4ed8-b239-eaa384706c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:02.546898 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a9420653-90db-4ed8-b239-eaa384706c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:02.547965 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 187/382] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:02 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1283 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:02.548520 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a9420653-90db-4ed8-b239-eaa384706c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:02.551845 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a9420653-90db-4ed8-b239-eaa384706c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:02.552406 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a9420653-90db-4ed8-b239-eaa384706c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:02.552848 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a9420653-90db-4ed8-b239-eaa384706c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:02.582579 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:02.734225 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a9420653-90db-4ed8-b239-eaa384706c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:02.744640 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a9420653-90db-4ed8-b239-eaa384706c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.215784 Aug 22 05:41:02.758618 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 196/383] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:02 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:03.571289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-121e1fce-c0cf-46fd-a77c-e7943ddf2a7c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:03.576869 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-121e1fce-c0cf-46fd-a77c-e7943ddf2a7c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:03.594252 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-121e1fce-c0cf-46fd-a77c-e7943ddf2a7c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:03.595050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-121e1fce-c0cf-46fd-a77c-e7943ddf2a7c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:03.596143 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-121e1fce-c0cf-46fd-a77c-e7943ddf2a7c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:03.597056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-121e1fce-c0cf-46fd-a77c-e7943ddf2a7c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:03.597805 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-121e1fce-c0cf-46fd-a77c-e7943ddf2a7c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:03.600705 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-121e1fce-c0cf-46fd-a77c-e7943ddf2a7c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:03.696783 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-121e1fce-c0cf-46fd-a77c-e7943ddf2a7c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:03.711763 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-121e1fce-c0cf-46fd-a77c-e7943ddf2a7c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1283 microversion: 2.1 time: 0.145540 Aug 22 05:41:03.712411 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 188/384] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:03 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1283 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:03.765953 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6f1b7005-7adb-4504-a84d-f2a766e5b743 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:03.766955 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-6f1b7005-7adb-4504-a84d-f2a766e5b743 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:03.781827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6f1b7005-7adb-4504-a84d-f2a766e5b743 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:03.782315 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6f1b7005-7adb-4504-a84d-f2a766e5b743 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:03.782745 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6f1b7005-7adb-4504-a84d-f2a766e5b743 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:03.783453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6f1b7005-7adb-4504-a84d-f2a766e5b743 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:03.783946 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6f1b7005-7adb-4504-a84d-f2a766e5b743 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:03.784357 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6f1b7005-7adb-4504-a84d-f2a766e5b743 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:04.002952 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6f1b7005-7adb-4504-a84d-f2a766e5b743 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:04.016678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6f1b7005-7adb-4504-a84d-f2a766e5b743 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.254603 Aug 22 05:41:04.017879 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 197/385] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:03 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:04.733704 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a067f1d0-ac80-4712-9cf3-d749bc387aa0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:04.734904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a067f1d0-ac80-4712-9cf3-d749bc387aa0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:04.746113 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a067f1d0-ac80-4712-9cf3-d749bc387aa0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:04.747007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a067f1d0-ac80-4712-9cf3-d749bc387aa0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:04.747727 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a067f1d0-ac80-4712-9cf3-d749bc387aa0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:04.748664 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a067f1d0-ac80-4712-9cf3-d749bc387aa0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:04.749284 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a067f1d0-ac80-4712-9cf3-d749bc387aa0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:04.749859 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a067f1d0-ac80-4712-9cf3-d749bc387aa0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:04.859388 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a067f1d0-ac80-4712-9cf3-d749bc387aa0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:04.870018 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a067f1d0-ac80-4712-9cf3-d749bc387aa0 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1271 microversion: 2.1 time: 0.140671 Aug 22 05:41:04.871172 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 189/386] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:04 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1271 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:05.039767 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c0c94256-acda-4960-b49f-16b76ece4493 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:05.041694 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c0c94256-acda-4960-b49f-16b76ece4493 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:05.049708 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c0c94256-acda-4960-b49f-16b76ece4493 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:05.050478 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c0c94256-acda-4960-b49f-16b76ece4493 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:05.051349 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c0c94256-acda-4960-b49f-16b76ece4493 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:05.052272 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c0c94256-acda-4960-b49f-16b76ece4493 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:05.052877 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c0c94256-acda-4960-b49f-16b76ece4493 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:05.053455 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c0c94256-acda-4960-b49f-16b76ece4493 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:05.370932 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c0c94256-acda-4960-b49f-16b76ece4493 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:05.379494 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c0c94256-acda-4960-b49f-16b76ece4493 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.344119 Aug 22 05:41:05.393967 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 198/387] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:05 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:05.906424 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9e987f20-43f4-4117-bce0-a9e263634091 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:05.909192 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9e987f20-43f4-4117-bce0-a9e263634091 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:05.937230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9e987f20-43f4-4117-bce0-a9e263634091 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:05.938803 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9e987f20-43f4-4117-bce0-a9e263634091 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:05.939806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9e987f20-43f4-4117-bce0-a9e263634091 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:05.940818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9e987f20-43f4-4117-bce0-a9e263634091 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:05.941321 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9e987f20-43f4-4117-bce0-a9e263634091 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:05.942038 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9e987f20-43f4-4117-bce0-a9e263634091 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:06.179029 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9e987f20-43f4-4117-bce0-a9e263634091 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:06.189299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9e987f20-43f4-4117-bce0-a9e263634091 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1313 microversion: 2.1 time: 0.295959 Aug 22 05:41:06.190256 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 190/388] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:05 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:06.401005 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b93b9d80-e80a-4a24-9785-db81050de18b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:06.402622 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b93b9d80-e80a-4a24-9785-db81050de18b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:06.411317 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b93b9d80-e80a-4a24-9785-db81050de18b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:06.412077 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b93b9d80-e80a-4a24-9785-db81050de18b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:06.412716 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b93b9d80-e80a-4a24-9785-db81050de18b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:06.413410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b93b9d80-e80a-4a24-9785-db81050de18b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:06.414069 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b93b9d80-e80a-4a24-9785-db81050de18b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:06.414612 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b93b9d80-e80a-4a24-9785-db81050de18b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:06.577247 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=2 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:06.598218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=6 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:06.666815 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b93b9d80-e80a-4a24-9785-db81050de18b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:06.675408 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b93b9d80-e80a-4a24-9785-db81050de18b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.278153 Aug 22 05:41:06.676032 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 199/389] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:06 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:07.076449 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:07.214437 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-41cd8c05-a50d-45fc-8bd9-f309d693afc8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:07.215182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-41cd8c05-a50d-45fc-8bd9-f309d693afc8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:07.222406 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-41cd8c05-a50d-45fc-8bd9-f309d693afc8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:07.222998 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-41cd8c05-a50d-45fc-8bd9-f309d693afc8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:07.223674 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-41cd8c05-a50d-45fc-8bd9-f309d693afc8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:07.224593 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-41cd8c05-a50d-45fc-8bd9-f309d693afc8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:07.225252 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-41cd8c05-a50d-45fc-8bd9-f309d693afc8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:07.225878 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-41cd8c05-a50d-45fc-8bd9-f309d693afc8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:07.275626 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-52a5c81e-6bb4-4758-a3ae-e4e33aaea8e6 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Action: 'create', calling method: .version_select at 0x7f0b3e9caf70>, body: {"keypair": {"name": "tempest-TestShelveInstance-364360750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCohjbqpMRwOQ2m/umwfts2MjhIYly4Fm/xiKqcRso8j1105DpyrhfMqKWxizxD+gfvRWTs6y0dLpAiWkbWgTU/aHl0xVKAo4/qx9OkmD5etc300cyNpoZngk8vI26oPA=="}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:07.299281 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-52a5c81e-6bb4-4758-a3ae-e4e33aaea8e6 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Getting quotas for project 638a0c07a94f43d4807931639fd6a93e. Resources: {'key_pairs'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:41:07.303193 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-52a5c81e-6bb4-4758-a3ae-e4e33aaea8e6 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Getting quotas for user f4010e99c30b4a49b19c6b8fa2b5f7f2 and project 638a0c07a94f43d4807931639fd6a93e. Resources: {'key_pairs'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:41:07.345017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-52a5c81e-6bb4-4758-a3ae-e4e33aaea8e6 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.273346 Aug 22 05:41:07.351889 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 191/390] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 22 05:41:07 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:41:07.556067 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-41cd8c05-a50d-45fc-8bd9-f309d693afc8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:07.567158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-41cd8c05-a50d-45fc-8bd9-f309d693afc8 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1313 microversion: 2.1 time: 0.359958 Aug 22 05:41:07.568742 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 200/391] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:07 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:07.698424 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4fc29f8c-e807-4f96-bfce-8c6485f9b55f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:07.699459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4fc29f8c-e807-4f96-bfce-8c6485f9b55f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:07.699631 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-c7b94a03-7ce2-4672-a175-21f125f22ce0 req-88ad8281-4166-456f-b83f-778df6d36d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4295082-964b-4620-8ffc-6fc6078058fe", "tag": "6a146665-b5bf-4c78-8623-a3e873c3f0ad"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:07.716155 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fc29f8c-e807-4f96-bfce-8c6485f9b55f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:07.717364 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fc29f8c-e807-4f96-bfce-8c6485f9b55f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:07.717928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fc29f8c-e807-4f96-bfce-8c6485f9b55f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:07.718055 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c7b94a03-7ce2-4672-a175-21f125f22ce0 req-88ad8281-4166-456f-b83f-778df6d36d93 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:07.720905 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fc29f8c-e807-4f96-bfce-8c6485f9b55f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:07.723707 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fc29f8c-e807-4f96-bfce-8c6485f9b55f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:07.724493 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fc29f8c-e807-4f96-bfce-8c6485f9b55f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:07.724764 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c7b94a03-7ce2-4672-a175-21f125f22ce0 req-88ad8281-4166-456f-b83f-778df6d36d93 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:07.725529 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c7b94a03-7ce2-4672-a175-21f125f22ce0 req-88ad8281-4166-456f-b83f-778df6d36d93 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:07.746943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-c7b94a03-7ce2-4672-a175-21f125f22ce0 req-88ad8281-4166-456f-b83f-778df6d36d93 service nova] Creating event network-changed:6a146665-b5bf-4c78-8623-a3e873c3f0ad for instance f4295082-964b-4620-8ffc-6fc6078058fe on hv-cinder-85391 Aug 22 05:41:07.760979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-c7b94a03-7ce2-4672-a175-21f125f22ce0 req-88ad8281-4166-456f-b83f-778df6d36d93 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069334 Aug 22 05:41:07.764454 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 192/392] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:41:07.962785 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4fc29f8c-e807-4f96-bfce-8c6485f9b55f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:07.973499 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4fc29f8c-e807-4f96-bfce-8c6485f9b55f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.279287 Aug 22 05:41:07.974753 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 201/393] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:07 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:08.590862 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-506c7498-8bc1-4e80-9b05-74c7366b6fce tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:08.591747 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-506c7498-8bc1-4e80-9b05-74c7366b6fce tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:08.601604 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-506c7498-8bc1-4e80-9b05-74c7366b6fce tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:08.602095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-506c7498-8bc1-4e80-9b05-74c7366b6fce tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:08.602505 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-506c7498-8bc1-4e80-9b05-74c7366b6fce tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:08.603238 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-506c7498-8bc1-4e80-9b05-74c7366b6fce tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:08.603696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-506c7498-8bc1-4e80-9b05-74c7366b6fce tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:08.604129 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-506c7498-8bc1-4e80-9b05-74c7366b6fce tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:08.850146 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-506c7498-8bc1-4e80-9b05-74c7366b6fce tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:08.858426 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-506c7498-8bc1-4e80-9b05-74c7366b6fce tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1313 microversion: 2.1 time: 0.272080 Aug 22 05:41:08.859089 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 193/394] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:08 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:08.996666 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ac307f2a-468e-45c7-8ead-8a5e410fc91c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:08.997277 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ac307f2a-468e-45c7-8ead-8a5e410fc91c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:09.003958 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ac307f2a-468e-45c7-8ead-8a5e410fc91c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:09.004634 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ac307f2a-468e-45c7-8ead-8a5e410fc91c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:09.005075 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ac307f2a-468e-45c7-8ead-8a5e410fc91c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:09.005879 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ac307f2a-468e-45c7-8ead-8a5e410fc91c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:09.006329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ac307f2a-468e-45c7-8ead-8a5e410fc91c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:09.006748 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ac307f2a-468e-45c7-8ead-8a5e410fc91c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:09.202137 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ac307f2a-468e-45c7-8ead-8a5e410fc91c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:09.219033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ac307f2a-468e-45c7-8ead-8a5e410fc91c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1501 microversion: 2.1 time: 0.226234 Aug 22 05:41:09.220095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 202/395] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:08 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1501 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:09.243361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5cd1ec81-bf92-4313-b520-977803126584 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e6c6cb1-8a21-42e2-b75b-808375a95080"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:09.246098 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5cd1ec81-bf92-4313-b520-977803126584 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:09.267321 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5cd1ec81-bf92-4313-b520-977803126584 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:09.270574 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5cd1ec81-bf92-4313-b520-977803126584 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:09.271353 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5cd1ec81-bf92-4313-b520-977803126584 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:09.275699 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5cd1ec81-bf92-4313-b520-977803126584 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:09.277465 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5cd1ec81-bf92-4313-b520-977803126584 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:09.278344 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5cd1ec81-bf92-4313-b520-977803126584 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:09.307446 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-5cd1ec81-bf92-4313-b520-977803126584 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] HTTP exception thrown: Cannot 'attach_volume' instance f8ee8e71-810f-4f41-af8a-9bed26135368 while it is in vm_state rescued Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5cd1ec81-bf92-4313-b520-977803126584 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Request method failure captured: Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: POST /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368/os-volume_attachments HTTP/1.1 Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 74 Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxZJ7BdnzK-u4DKWWTr2FX2u5pwmnE2XjOu8umL3m5FZVx9vs8-L9guf58r47bG_oFQDAwD733BJkilMph8nunSZNTzBoLdMj0DH2XIL-y0pAdClU7WOEjgndU2mtYSxv2QT6l_KuebCiUPUyx_PUd635STXp1Lia-VSwvM8EBbSje4 Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 8cadb48afce14e758bfe62771530527a Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1818501039 Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:41:09.309221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:41:09.310930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8cadb48afce14e758bfe62771530527a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cadb48afce14e758bfe62771530527a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cadb48afce14e758bfe62771530527a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8cadb48afce14e758bfe62771530527a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:41:09.310930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1818501039 Aug 22 05:41:09.310930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 8cadb48afce14e758bfe62771530527a Aug 22 05:41:09.310930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1818501039 Aug 22 05:41:09.310930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-ServerRescueNegativeTestJSON-1818501039-project Aug 22 05:41:09.310930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:41:09.310930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:41:09.310930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 9643b0f10e8345889c181efbb1978237 Aug 22 05:41:09.310930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1818501039-project Aug 22 05:41:09.310930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Aug 22 05:41:09.310930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {"volumeAttachment": {"volumeId": "5e6c6cb1-8a21-42e2-b75b-808375a95080"}} Aug 22 05:41:09.310930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Cannot 'attach_volume' instance f8ee8e71-810f-4f41-af8a-9bed26135368 while it is in vm_state rescued Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'server_id': 'f8ee8e71-810f-4f41-af8a-9bed26135368', 'body': {'volumeAttachment': {'volumeId': '5e6c6cb1-8a21-42e2-b75b-808375a95080'}}} Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f8ee8e71-810f-4f41-af8a-9bed26135368 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:41:09.312555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f8ee8e71-810f-4f41-af8a-9bed26135368 while it is in vm_state rescued Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:41:09.313816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:41:09.315361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:41:09.315361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:41:09.315361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f8ee8e71-810f-4f41-af8a-9bed26135368 while it is in vm_state rescued Aug 22 05:41:09.315361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:41:09.315361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5cd1ec81-bf92-4313-b520-977803126584 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Returning 409 to user: Cannot 'attach_volume' instance f8ee8e71-810f-4f41-af8a-9bed26135368 while it is in vm_state rescued {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:41:09.315361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5cd1ec81-bf92-4313-b520-977803126584 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "POST /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.072232 Aug 22 05:41:09.315361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 194/396] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 22 05:41:09 2022] POST /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368/os-volume_attachments => generated 152 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 22 05:41:09.320513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-03a8a548-3e0d-4471-852f-c42ec507adc0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:09.321050 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-03a8a548-3e0d-4471-852f-c42ec507adc0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:09.327408 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-03a8a548-3e0d-4471-852f-c42ec507adc0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:09.328134 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-03a8a548-3e0d-4471-852f-c42ec507adc0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:09.328750 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-03a8a548-3e0d-4471-852f-c42ec507adc0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:09.329621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-03a8a548-3e0d-4471-852f-c42ec507adc0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:09.330239 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-03a8a548-3e0d-4471-852f-c42ec507adc0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:09.330813 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-03a8a548-3e0d-4471-852f-c42ec507adc0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:09.501105 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-03a8a548-3e0d-4471-852f-c42ec507adc0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "POST /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368/action" status: 202 len: 0 microversion: 2.1 time: 0.184227 Aug 22 05:41:09.505052 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 203/397] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 22 05:41:09 2022] POST /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:41:09.511016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8fb95170-b01c-4e30-ad4f-8b272a93b67a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:09.511993 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8fb95170-b01c-4e30-ad4f-8b272a93b67a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:09.520861 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8fb95170-b01c-4e30-ad4f-8b272a93b67a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:09.521765 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8fb95170-b01c-4e30-ad4f-8b272a93b67a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:09.522458 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8fb95170-b01c-4e30-ad4f-8b272a93b67a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:09.523312 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8fb95170-b01c-4e30-ad4f-8b272a93b67a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:09.523997 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8fb95170-b01c-4e30-ad4f-8b272a93b67a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:09.524562 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8fb95170-b01c-4e30-ad4f-8b272a93b67a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:09.693171 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8fb95170-b01c-4e30-ad4f-8b272a93b67a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:09.701730 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8fb95170-b01c-4e30-ad4f-8b272a93b67a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1509 microversion: 2.1 time: 0.195331 Aug 22 05:41:09.702293 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 195/398] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:09 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:09.880796 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b78e1ea6-8c15-4177-9ade-e5d077f50725 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:09.881990 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b78e1ea6-8c15-4177-9ade-e5d077f50725 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:09.890610 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b78e1ea6-8c15-4177-9ade-e5d077f50725 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:09.891081 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b78e1ea6-8c15-4177-9ade-e5d077f50725 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:09.902876 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b78e1ea6-8c15-4177-9ade-e5d077f50725 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:09.903688 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b78e1ea6-8c15-4177-9ade-e5d077f50725 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:09.905068 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b78e1ea6-8c15-4177-9ade-e5d077f50725 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:09.905462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b78e1ea6-8c15-4177-9ade-e5d077f50725 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:10.047792 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b78e1ea6-8c15-4177-9ade-e5d077f50725 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:10.056399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b78e1ea6-8c15-4177-9ade-e5d077f50725 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1313 microversion: 2.1 time: 0.180193 Aug 22 05:41:10.056966 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 204/399] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:09 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:10.724217 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-19935a78-f8c6-40d8-bba6-725f9c848181 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:10.724934 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-19935a78-f8c6-40d8-bba6-725f9c848181 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:10.732178 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19935a78-f8c6-40d8-bba6-725f9c848181 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:10.732808 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19935a78-f8c6-40d8-bba6-725f9c848181 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:10.733241 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19935a78-f8c6-40d8-bba6-725f9c848181 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:10.733930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19935a78-f8c6-40d8-bba6-725f9c848181 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:10.734373 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19935a78-f8c6-40d8-bba6-725f9c848181 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:10.734814 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19935a78-f8c6-40d8-bba6-725f9c848181 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:10.886812 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-19935a78-f8c6-40d8-bba6-725f9c848181 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:10.895927 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-19935a78-f8c6-40d8-bba6-725f9c848181 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1509 microversion: 2.1 time: 0.175558 Aug 22 05:41:10.896508 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 196/400] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:10 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:11.078980 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-738f0703-8ed9-4b07-8788-0adeb7c7d9fe tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:11.080923 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-738f0703-8ed9-4b07-8788-0adeb7c7d9fe tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:11.083767 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:11.089544 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-738f0703-8ed9-4b07-8788-0adeb7c7d9fe tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:11.090080 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-738f0703-8ed9-4b07-8788-0adeb7c7d9fe tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:11.090547 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-738f0703-8ed9-4b07-8788-0adeb7c7d9fe tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:11.091472 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-738f0703-8ed9-4b07-8788-0adeb7c7d9fe tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:11.092794 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-738f0703-8ed9-4b07-8788-0adeb7c7d9fe tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:11.093528 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-738f0703-8ed9-4b07-8788-0adeb7c7d9fe tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:11.247219 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-738f0703-8ed9-4b07-8788-0adeb7c7d9fe tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:11.255537 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-738f0703-8ed9-4b07-8788-0adeb7c7d9fe tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1313 microversion: 2.1 time: 0.181543 Aug 22 05:41:11.256135 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 205/401] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:11 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:11.919730 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5225b30b-b5c4-4319-a992-f250ff7361e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:11.920437 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5225b30b-b5c4-4319-a992-f250ff7361e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:11.926688 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5225b30b-b5c4-4319-a992-f250ff7361e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:11.927171 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5225b30b-b5c4-4319-a992-f250ff7361e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:11.927683 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5225b30b-b5c4-4319-a992-f250ff7361e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:11.928424 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5225b30b-b5c4-4319-a992-f250ff7361e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:11.930616 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5225b30b-b5c4-4319-a992-f250ff7361e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:11.931758 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5225b30b-b5c4-4319-a992-f250ff7361e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:12.066052 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5225b30b-b5c4-4319-a992-f250ff7361e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:12.074889 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5225b30b-b5c4-4319-a992-f250ff7361e1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1509 microversion: 2.1 time: 0.159086 Aug 22 05:41:12.075459 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 197/402] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:11 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:12.277312 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-1fb03876-0cef-42ee-884d-e90a840ef25b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:12.277902 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-1fb03876-0cef-42ee-884d-e90a840ef25b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:12.285186 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1fb03876-0cef-42ee-884d-e90a840ef25b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:12.285675 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1fb03876-0cef-42ee-884d-e90a840ef25b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:12.286109 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1fb03876-0cef-42ee-884d-e90a840ef25b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:12.286810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1fb03876-0cef-42ee-884d-e90a840ef25b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:12.287259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1fb03876-0cef-42ee-884d-e90a840ef25b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:12.287713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1fb03876-0cef-42ee-884d-e90a840ef25b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:12.438893 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-1fb03876-0cef-42ee-884d-e90a840ef25b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:12.451324 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-1fb03876-0cef-42ee-884d-e90a840ef25b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1313 microversion: 2.1 time: 0.178234 Aug 22 05:41:12.452128 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 206/403] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:12 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:13.106034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8d20fba3-9c5c-4c0d-8e3a-54e3b065e187 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:13.106753 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8d20fba3-9c5c-4c0d-8e3a-54e3b065e187 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:13.115365 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8d20fba3-9c5c-4c0d-8e3a-54e3b065e187 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:13.115878 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8d20fba3-9c5c-4c0d-8e3a-54e3b065e187 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:13.116310 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8d20fba3-9c5c-4c0d-8e3a-54e3b065e187 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:13.117203 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8d20fba3-9c5c-4c0d-8e3a-54e3b065e187 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:13.117670 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8d20fba3-9c5c-4c0d-8e3a-54e3b065e187 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:13.118127 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8d20fba3-9c5c-4c0d-8e3a-54e3b065e187 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:13.334683 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8d20fba3-9c5c-4c0d-8e3a-54e3b065e187 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:13.347457 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8d20fba3-9c5c-4c0d-8e3a-54e3b065e187 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1509 microversion: 2.1 time: 0.250590 Aug 22 05:41:13.348725 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 198/404] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:13 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:13.480121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a131a551-08d2-4464-be6b-97f93fa53c74 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:13.482545 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a131a551-08d2-4464-be6b-97f93fa53c74 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:13.492733 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a131a551-08d2-4464-be6b-97f93fa53c74 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:13.493585 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a131a551-08d2-4464-be6b-97f93fa53c74 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:13.495088 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a131a551-08d2-4464-be6b-97f93fa53c74 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:13.496240 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a131a551-08d2-4464-be6b-97f93fa53c74 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:13.496910 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a131a551-08d2-4464-be6b-97f93fa53c74 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:13.497712 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a131a551-08d2-4464-be6b-97f93fa53c74 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:13.871508 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a131a551-08d2-4464-be6b-97f93fa53c74 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:13.880461 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a131a551-08d2-4464-be6b-97f93fa53c74 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1313 microversion: 2.1 time: 0.406069 Aug 22 05:41:13.881617 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 207/405] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:13 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:14.370972 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6ec7ef96-ff1a-4c52-b319-fb644622b25d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:14.371821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6ec7ef96-ff1a-4c52-b319-fb644622b25d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:14.378623 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6ec7ef96-ff1a-4c52-b319-fb644622b25d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:14.379232 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6ec7ef96-ff1a-4c52-b319-fb644622b25d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:14.379802 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6ec7ef96-ff1a-4c52-b319-fb644622b25d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:14.380589 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6ec7ef96-ff1a-4c52-b319-fb644622b25d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:14.381251 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6ec7ef96-ff1a-4c52-b319-fb644622b25d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:14.382163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6ec7ef96-ff1a-4c52-b319-fb644622b25d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:14.530182 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6ec7ef96-ff1a-4c52-b319-fb644622b25d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:14.539940 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6ec7ef96-ff1a-4c52-b319-fb644622b25d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1509 microversion: 2.1 time: 0.172961 Aug 22 05:41:14.541198 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 199/406] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:14 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:14.910708 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7556a13e-0efe-4ca5-bc69-93121fe54c0b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:14.911396 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-7556a13e-0efe-4ca5-bc69-93121fe54c0b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:14.918258 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7556a13e-0efe-4ca5-bc69-93121fe54c0b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:14.918729 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7556a13e-0efe-4ca5-bc69-93121fe54c0b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:14.919141 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7556a13e-0efe-4ca5-bc69-93121fe54c0b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:14.919944 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7556a13e-0efe-4ca5-bc69-93121fe54c0b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:14.920383 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7556a13e-0efe-4ca5-bc69-93121fe54c0b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:14.920761 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7556a13e-0efe-4ca5-bc69-93121fe54c0b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:15.072080 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-7556a13e-0efe-4ca5-bc69-93121fe54c0b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:15.080482 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-7556a13e-0efe-4ca5-bc69-93121fe54c0b tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1313 microversion: 2.1 time: 0.173831 Aug 22 05:41:15.081049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 208/407] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:14 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:15.565267 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a4b582d6-dd0a-42ae-980a-ef982b46e36b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:15.566090 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a4b582d6-dd0a-42ae-980a-ef982b46e36b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:15.574398 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a4b582d6-dd0a-42ae-980a-ef982b46e36b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:15.575059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a4b582d6-dd0a-42ae-980a-ef982b46e36b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:15.575709 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a4b582d6-dd0a-42ae-980a-ef982b46e36b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:15.576616 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a4b582d6-dd0a-42ae-980a-ef982b46e36b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:15.577205 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a4b582d6-dd0a-42ae-980a-ef982b46e36b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:15.577763 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a4b582d6-dd0a-42ae-980a-ef982b46e36b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:15.717334 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a4b582d6-dd0a-42ae-980a-ef982b46e36b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:15.719760 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:15.727263 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a4b582d6-dd0a-42ae-980a-ef982b46e36b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1509 microversion: 2.1 time: 0.167695 Aug 22 05:41:15.727867 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 200/408] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:15 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:16.105936 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b656f770-093b-4c08-9c2a-1973a443e127 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:16.107323 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b656f770-093b-4c08-9c2a-1973a443e127 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:16.118446 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b656f770-093b-4c08-9c2a-1973a443e127 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:16.119291 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b656f770-093b-4c08-9c2a-1973a443e127 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:16.120108 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b656f770-093b-4c08-9c2a-1973a443e127 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:16.121213 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b656f770-093b-4c08-9c2a-1973a443e127 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:16.121959 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b656f770-093b-4c08-9c2a-1973a443e127 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:16.122740 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b656f770-093b-4c08-9c2a-1973a443e127 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:16.254126 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b656f770-093b-4c08-9c2a-1973a443e127 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:16.262474 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b656f770-093b-4c08-9c2a-1973a443e127 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1313 microversion: 2.1 time: 0.163260 Aug 22 05:41:16.263089 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 209/409] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:16 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:16.750817 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-330477cf-eb20-4e1a-a038-1ac7417cae51 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:16.751375 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-330477cf-eb20-4e1a-a038-1ac7417cae51 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:16.757727 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-330477cf-eb20-4e1a-a038-1ac7417cae51 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:16.758200 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-330477cf-eb20-4e1a-a038-1ac7417cae51 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:16.758628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-330477cf-eb20-4e1a-a038-1ac7417cae51 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:16.759312 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-330477cf-eb20-4e1a-a038-1ac7417cae51 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:16.759791 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-330477cf-eb20-4e1a-a038-1ac7417cae51 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:16.760208 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-330477cf-eb20-4e1a-a038-1ac7417cae51 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:16.905704 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-330477cf-eb20-4e1a-a038-1ac7417cae51 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:16.913714 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-330477cf-eb20-4e1a-a038-1ac7417cae51 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1509 microversion: 2.1 time: 0.167823 Aug 22 05:41:16.914507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 201/410] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:16 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:17.293612 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0c23355f-4287-40a1-a939-e461c93d38a9 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:17.294529 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0c23355f-4287-40a1-a939-e461c93d38a9 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:17.301682 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0c23355f-4287-40a1-a939-e461c93d38a9 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:17.302153 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0c23355f-4287-40a1-a939-e461c93d38a9 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:17.302572 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0c23355f-4287-40a1-a939-e461c93d38a9 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:17.303249 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0c23355f-4287-40a1-a939-e461c93d38a9 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:17.303723 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0c23355f-4287-40a1-a939-e461c93d38a9 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:17.304135 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0c23355f-4287-40a1-a939-e461c93d38a9 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:17.444152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0c23355f-4287-40a1-a939-e461c93d38a9 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:17.453179 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0c23355f-4287-40a1-a939-e461c93d38a9 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1313 microversion: 2.1 time: 0.166212 Aug 22 05:41:17.453739 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 210/411] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:17 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:17.935690 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-52ca7467-482e-4187-8dc6-927952268ded tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:17.936309 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-52ca7467-482e-4187-8dc6-927952268ded tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:17.938270 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=4 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:17.944012 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-52ca7467-482e-4187-8dc6-927952268ded tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:17.944492 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-52ca7467-482e-4187-8dc6-927952268ded tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:17.944928 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-52ca7467-482e-4187-8dc6-927952268ded tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:17.945613 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-52ca7467-482e-4187-8dc6-927952268ded tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:17.946048 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-52ca7467-482e-4187-8dc6-927952268ded tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:17.946468 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-52ca7467-482e-4187-8dc6-927952268ded tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:18.087986 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-52ca7467-482e-4187-8dc6-927952268ded tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:18.096593 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-52ca7467-482e-4187-8dc6-927952268ded tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1509 microversion: 2.1 time: 0.164886 Aug 22 05:41:18.097173 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 202/412] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:17 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:18.474354 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ce13cd9e-1d6c-4dc2-bc76-4a53d72db33e tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:18.474962 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ce13cd9e-1d6c-4dc2-bc76-4a53d72db33e tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:18.481786 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ce13cd9e-1d6c-4dc2-bc76-4a53d72db33e tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:18.482256 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ce13cd9e-1d6c-4dc2-bc76-4a53d72db33e tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:18.482676 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ce13cd9e-1d6c-4dc2-bc76-4a53d72db33e tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:18.483396 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ce13cd9e-1d6c-4dc2-bc76-4a53d72db33e tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:18.483893 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ce13cd9e-1d6c-4dc2-bc76-4a53d72db33e tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:18.484313 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ce13cd9e-1d6c-4dc2-bc76-4a53d72db33e tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:18.619753 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ce13cd9e-1d6c-4dc2-bc76-4a53d72db33e tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:18.628130 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ce13cd9e-1d6c-4dc2-bc76-4a53d72db33e tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1313 microversion: 2.1 time: 0.157745 Aug 22 05:41:18.628703 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 211/413] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:18 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:19.118221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-00c49e50-b4ac-4dfd-afbb-200aa3191456 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:19.119005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-00c49e50-b4ac-4dfd-afbb-200aa3191456 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:19.125471 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00c49e50-b4ac-4dfd-afbb-200aa3191456 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:19.125951 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00c49e50-b4ac-4dfd-afbb-200aa3191456 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:19.126383 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00c49e50-b4ac-4dfd-afbb-200aa3191456 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:19.127073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00c49e50-b4ac-4dfd-afbb-200aa3191456 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:19.127693 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00c49e50-b4ac-4dfd-afbb-200aa3191456 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:19.128107 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00c49e50-b4ac-4dfd-afbb-200aa3191456 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:19.272746 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-00c49e50-b4ac-4dfd-afbb-200aa3191456 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:19.283010 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-00c49e50-b4ac-4dfd-afbb-200aa3191456 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1509 microversion: 2.1 time: 0.169223 Aug 22 05:41:19.283592 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 203/414] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:19 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:19.648439 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-fd7587b2-8868-45fc-8482-62e0e45ae07c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:19.649120 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-fd7587b2-8868-45fc-8482-62e0e45ae07c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:19.656437 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fd7587b2-8868-45fc-8482-62e0e45ae07c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:19.657205 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fd7587b2-8868-45fc-8482-62e0e45ae07c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:19.657805 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fd7587b2-8868-45fc-8482-62e0e45ae07c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:19.658742 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fd7587b2-8868-45fc-8482-62e0e45ae07c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:19.659178 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fd7587b2-8868-45fc-8482-62e0e45ae07c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:19.659610 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fd7587b2-8868-45fc-8482-62e0e45ae07c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:19.664132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:19.800311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-fd7587b2-8868-45fc-8482-62e0e45ae07c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:19.808993 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-fd7587b2-8868-45fc-8482-62e0e45ae07c tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1313 microversion: 2.1 time: 0.164460 Aug 22 05:41:19.809562 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 212/415] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:19 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:20.304893 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-17d9c9fc-da9c-4a01-ac9c-90dcae44085c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:20.305461 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-17d9c9fc-da9c-4a01-ac9c-90dcae44085c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:20.311613 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17d9c9fc-da9c-4a01-ac9c-90dcae44085c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:20.312101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17d9c9fc-da9c-4a01-ac9c-90dcae44085c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:20.312667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17d9c9fc-da9c-4a01-ac9c-90dcae44085c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:20.313452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17d9c9fc-da9c-4a01-ac9c-90dcae44085c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:20.313897 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17d9c9fc-da9c-4a01-ac9c-90dcae44085c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:20.314337 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17d9c9fc-da9c-4a01-ac9c-90dcae44085c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:20.455952 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-17d9c9fc-da9c-4a01-ac9c-90dcae44085c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:20.465723 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-17d9c9fc-da9c-4a01-ac9c-90dcae44085c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1509 microversion: 2.1 time: 0.164599 Aug 22 05:41:20.466425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 204/416] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:20 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:20.831511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-671db5d9-dd3d-41a5-bf34-e44b9ad4a5fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:20.832514 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-671db5d9-dd3d-41a5-bf34-e44b9ad4a5fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:20.839317 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-671db5d9-dd3d-41a5-bf34-e44b9ad4a5fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:20.839823 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-671db5d9-dd3d-41a5-bf34-e44b9ad4a5fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:20.840259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-671db5d9-dd3d-41a5-bf34-e44b9ad4a5fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:20.840964 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-671db5d9-dd3d-41a5-bf34-e44b9ad4a5fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:20.841427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-671db5d9-dd3d-41a5-bf34-e44b9ad4a5fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:20.842228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-671db5d9-dd3d-41a5-bf34-e44b9ad4a5fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:20.984145 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-671db5d9-dd3d-41a5-bf34-e44b9ad4a5fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:20.992167 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-671db5d9-dd3d-41a5-bf34-e44b9ad4a5fb tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1313 microversion: 2.1 time: 0.165679 Aug 22 05:41:20.992736 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 213/417] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:20 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:21.303593 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1974355307", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:21.362642 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] validate_networks() for None {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:41:21.489032 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a3838017-d1e9-4395-8737-519824b17ff1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:21.489693 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a3838017-d1e9-4395-8737-519824b17ff1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:21.497239 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3838017-d1e9-4395-8737-519824b17ff1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:21.498134 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3838017-d1e9-4395-8737-519824b17ff1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:21.498726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3838017-d1e9-4395-8737-519824b17ff1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:21.499533 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3838017-d1e9-4395-8737-519824b17ff1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:21.500322 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3838017-d1e9-4395-8737-519824b17ff1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:21.500942 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3838017-d1e9-4395-8737-519824b17ff1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:21.778657 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:41:21.779203 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:41:21.779997 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:41:21.780500 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:41:21.781003 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:41:21.791484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:21.792195 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:21.792714 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:21.793945 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:21.794637 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:21.795036 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a3838017-d1e9-4395-8737-519824b17ff1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:21.795185 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:21.806921 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a3838017-d1e9-4395-8737-519824b17ff1 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1509 microversion: 2.1 time: 0.322612 Aug 22 05:41:21.807926 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 214/418] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:21 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1509 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:21.832500 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Getting quotas for project e0ba1bb080a9456a9a5b567f33c45bd3. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:41:21.836879 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Getting quotas for user 81d09306a85048e19c8b83b787d81877 and project e0ba1bb080a9456a9a5b567f33c45bd3. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:41:21.848940 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:41:21.851296 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:41:21.901143 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0b0a4d14-5822-43b8-94a6-87510d91599a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601449 Aug 22 05:41:21.902110 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 205/419] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:41:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:41:21.914252 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6e616944-e332-40f7-99ee-bf0115bc830f tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:21.915857 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-6e616944-e332-40f7-99ee-bf0115bc830f tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:21.955469 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-8a765308-7aa6-4ac7-a6cb-f669c7162b04 req-92d38bb3-6e76-4fa5-a4b9-efd9e0a5e56d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4295082-964b-4620-8ffc-6fc6078058fe", "name": "network-vif-plugged", "status": "completed", "tag": "6a146665-b5bf-4c78-8623-a3e873c3f0ad"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:21.984597 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-8a765308-7aa6-4ac7-a6cb-f669c7162b04 req-92d38bb3-6e76-4fa5-a4b9-efd9e0a5e56d service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:21.989837 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-8a765308-7aa6-4ac7-a6cb-f669c7162b04 req-92d38bb3-6e76-4fa5-a4b9-efd9e0a5e56d service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:21.990679 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-8a765308-7aa6-4ac7-a6cb-f669c7162b04 req-92d38bb3-6e76-4fa5-a4b9-efd9e0a5e56d service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:22.015779 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-8a765308-7aa6-4ac7-a6cb-f669c7162b04 req-92d38bb3-6e76-4fa5-a4b9-efd9e0a5e56d service nova] Creating event network-vif-plugged:6a146665-b5bf-4c78-8623-a3e873c3f0ad for instance f4295082-964b-4620-8ffc-6fc6078058fe on hv-cinder-85391 Aug 22 05:41:22.025613 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-8a765308-7aa6-4ac7-a6cb-f669c7162b04 req-92d38bb3-6e76-4fa5-a4b9-efd9e0a5e56d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075596 Aug 22 05:41:22.027915 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 206/420] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:41:22.028046 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6e616944-e332-40f7-99ee-bf0115bc830f tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:22.037342 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6e68c301-6fbc-4957-bef9-c2a3df35bd89 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:22.037816 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6e616944-e332-40f7-99ee-bf0115bc830f tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1215 microversion: 2.1 time: 0.127215 Aug 22 05:41:22.038418 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6e68c301-6fbc-4957-bef9-c2a3df35bd89 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:22.053746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 215/421] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:21 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1215 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:22.065618 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6e68c301-6fbc-4957-bef9-c2a3df35bd89 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:22.066351 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6e68c301-6fbc-4957-bef9-c2a3df35bd89 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:22.066923 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6e68c301-6fbc-4957-bef9-c2a3df35bd89 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:22.067983 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6e68c301-6fbc-4957-bef9-c2a3df35bd89 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:22.068435 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6e68c301-6fbc-4957-bef9-c2a3df35bd89 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:22.069034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6e68c301-6fbc-4957-bef9-c2a3df35bd89 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:22.452692 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6e68c301-6fbc-4957-bef9-c2a3df35bd89 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:22.462049 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6e68c301-6fbc-4957-bef9-c2a3df35bd89 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1313 microversion: 2.1 time: 0.431150 Aug 22 05:41:22.462830 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 207/422] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:22 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:22.835533 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-15519b1b-e95e-4fa5-972c-350f1a855907 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:22.836075 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-15519b1b-e95e-4fa5-972c-350f1a855907 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:22.844948 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-15519b1b-e95e-4fa5-972c-350f1a855907 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:22.845455 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-15519b1b-e95e-4fa5-972c-350f1a855907 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:22.846037 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-15519b1b-e95e-4fa5-972c-350f1a855907 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:22.847034 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-15519b1b-e95e-4fa5-972c-350f1a855907 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:22.847842 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-15519b1b-e95e-4fa5-972c-350f1a855907 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:22.848765 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-15519b1b-e95e-4fa5-972c-350f1a855907 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:23.060817 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f3d83eb9-40b8-4b7b-9bf1-2dddb6b1e823 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:23.061458 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f3d83eb9-40b8-4b7b-9bf1-2dddb6b1e823 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:23.063639 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:23.068996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3d83eb9-40b8-4b7b-9bf1-2dddb6b1e823 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:23.069507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3d83eb9-40b8-4b7b-9bf1-2dddb6b1e823 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:23.069951 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3d83eb9-40b8-4b7b-9bf1-2dddb6b1e823 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:23.070648 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3d83eb9-40b8-4b7b-9bf1-2dddb6b1e823 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:23.071096 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3d83eb9-40b8-4b7b-9bf1-2dddb6b1e823 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:23.071517 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3d83eb9-40b8-4b7b-9bf1-2dddb6b1e823 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:23.081715 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-15519b1b-e95e-4fa5-972c-350f1a855907 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:23.090640 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-15519b1b-e95e-4fa5-972c-350f1a855907 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1515 microversion: 2.1 time: 0.261545 Aug 22 05:41:23.091132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 216/423] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:22 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1515 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:23.150112 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f3d83eb9-40b8-4b7b-9bf1-2dddb6b1e823 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:23.159259 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f3d83eb9-40b8-4b7b-9bf1-2dddb6b1e823 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1267 microversion: 2.1 time: 0.102145 Aug 22 05:41:23.160039 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 208/424] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:23 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1267 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:23.488960 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f69d3b7e-f782-4487-8232-6222bfecff39 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:23.489597 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f69d3b7e-f782-4487-8232-6222bfecff39 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:23.495654 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f69d3b7e-f782-4487-8232-6222bfecff39 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:23.496140 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f69d3b7e-f782-4487-8232-6222bfecff39 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:23.496576 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f69d3b7e-f782-4487-8232-6222bfecff39 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:23.497253 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f69d3b7e-f782-4487-8232-6222bfecff39 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:23.497694 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f69d3b7e-f782-4487-8232-6222bfecff39 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:23.498106 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f69d3b7e-f782-4487-8232-6222bfecff39 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:23.634739 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-f69d3b7e-f782-4487-8232-6222bfecff39 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:23.645570 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f69d3b7e-f782-4487-8232-6222bfecff39 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1313 microversion: 2.1 time: 0.160923 Aug 22 05:41:23.646361 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 217/425] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:23 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:24.182109 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1b3e4e59-541b-4e16-9054-9f49dc93fb0f tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:24.183337 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1b3e4e59-541b-4e16-9054-9f49dc93fb0f tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:24.191435 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1b3e4e59-541b-4e16-9054-9f49dc93fb0f tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:24.192342 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1b3e4e59-541b-4e16-9054-9f49dc93fb0f tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:24.192939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1b3e4e59-541b-4e16-9054-9f49dc93fb0f tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:24.193811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1b3e4e59-541b-4e16-9054-9f49dc93fb0f tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:24.194441 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1b3e4e59-541b-4e16-9054-9f49dc93fb0f tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:24.194954 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1b3e4e59-541b-4e16-9054-9f49dc93fb0f tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:24.260725 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1b3e4e59-541b-4e16-9054-9f49dc93fb0f tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:24.268973 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1b3e4e59-541b-4e16-9054-9f49dc93fb0f tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1275 microversion: 2.1 time: 0.091325 Aug 22 05:41:24.269574 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 209/426] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:24 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:24.472810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-53cfa3b1-6498-4b31-b355-63f2728f0e1c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Action: 'create', calling method: .version_select at 0x7f0b3e04e4c0>, body: {"keypair": {"name": "tempest-keypair-1988694950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOo/Zl12MIvzYvDcnzgKADKLkeV8CSdAIb78uOU1PTEF54geEi5aL6ADxpDUHvcyhzFPCtgRjEJ4dC0T0i7zYZB8L88uC7dU6Bq8XOZETV/IQ0c8jpdvMv26tDytb03svw=="}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:24.488784 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-53cfa3b1-6498-4b31-b355-63f2728f0e1c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Getting quotas for project 8cadb48afce14e758bfe62771530527a. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:41:24.492550 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-53cfa3b1-6498-4b31-b355-63f2728f0e1c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Getting quotas for user 9643b0f10e8345889c181efbb1978237 and project 8cadb48afce14e758bfe62771530527a. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:41:24.515735 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-53cfa3b1-6498-4b31-b355-63f2728f0e1c tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046878 Aug 22 05:41:24.516325 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 218/427] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 22 05:41:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:41:24.670917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-11ca3cbc-acf0-490d-bb87-eddb723da4a1 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:24.672058 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-11ca3cbc-acf0-490d-bb87-eddb723da4a1 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:24.688075 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11ca3cbc-acf0-490d-bb87-eddb723da4a1 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:24.688652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11ca3cbc-acf0-490d-bb87-eddb723da4a1 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:24.689092 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11ca3cbc-acf0-490d-bb87-eddb723da4a1 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:24.689806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11ca3cbc-acf0-490d-bb87-eddb723da4a1 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:24.690276 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11ca3cbc-acf0-490d-bb87-eddb723da4a1 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:24.690719 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11ca3cbc-acf0-490d-bb87-eddb723da4a1 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:24.910226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-11ca3cbc-acf0-490d-bb87-eddb723da4a1 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:24.918261 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-11ca3cbc-acf0-490d-bb87-eddb723da4a1 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1497 microversion: 2.1 time: 0.252414 Aug 22 05:41:24.918942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 210/428] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:24 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1497 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:25.290863 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-d2245196-d1e4-459c-a23a-28893f0cfbca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:25.291490 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-d2245196-d1e4-459c-a23a-28893f0cfbca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:25.299920 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d2245196-d1e4-459c-a23a-28893f0cfbca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:25.301164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d2245196-d1e4-459c-a23a-28893f0cfbca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:25.301945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d2245196-d1e4-459c-a23a-28893f0cfbca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:25.303677 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d2245196-d1e4-459c-a23a-28893f0cfbca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:25.305624 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d2245196-d1e4-459c-a23a-28893f0cfbca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:25.306581 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d2245196-d1e4-459c-a23a-28893f0cfbca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:25.388257 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-d2245196-d1e4-459c-a23a-28893f0cfbca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:25.399856 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-d2245196-d1e4-459c-a23a-28893f0cfbca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1273 microversion: 2.1 time: 0.113302 Aug 22 05:41:25.401063 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 219/429] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:25 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1273 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:25.539331 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-de7d520e-a57d-4587-ba53-74aed931de07 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:25.540590 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-de7d520e-a57d-4587-ba53-74aed931de07 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:25.551615 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de7d520e-a57d-4587-ba53-74aed931de07 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:25.554213 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de7d520e-a57d-4587-ba53-74aed931de07 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:25.554942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de7d520e-a57d-4587-ba53-74aed931de07 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:25.555858 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de7d520e-a57d-4587-ba53-74aed931de07 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:25.556545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de7d520e-a57d-4587-ba53-74aed931de07 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:25.557207 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de7d520e-a57d-4587-ba53-74aed931de07 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:25.604700 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-de7d520e-a57d-4587-ba53-74aed931de07 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:41:25.820777 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-de7d520e-a57d-4587-ba53-74aed931de07 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 204 len: 0 microversion: 2.1 time: 0.284830 Aug 22 05:41:25.822371 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 211/430] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:41:25 2022] DELETE /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:41:25.834451 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c6f4b698-c136-4631-8c62-2072bc28bea6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:25.835065 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c6f4b698-c136-4631-8c62-2072bc28bea6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:25.844305 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c6f4b698-c136-4631-8c62-2072bc28bea6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:25.844791 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c6f4b698-c136-4631-8c62-2072bc28bea6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:25.845227 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c6f4b698-c136-4631-8c62-2072bc28bea6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:25.845934 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c6f4b698-c136-4631-8c62-2072bc28bea6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:25.846385 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c6f4b698-c136-4631-8c62-2072bc28bea6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:25.848935 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c6f4b698-c136-4631-8c62-2072bc28bea6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:26.123767 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c6f4b698-c136-4631-8c62-2072bc28bea6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:26.135205 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c6f4b698-c136-4631-8c62-2072bc28bea6 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1503 microversion: 2.1 time: 0.307437 Aug 22 05:41:26.136489 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 220/431] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:25 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:26.246005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-326816785", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23303343-c5c8-4098-b67c-994458fa3aea"}], "security_groups": [{"name": "tempest-securitygroup--1663560159"}], "key_name": "tempest-keypair-1988694950", "user_data": "}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:26.417161 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] validate_networks() for [('23303343-c5c8-4098-b67c-994458fa3aea', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:41:26.424683 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-25b965d9-54ae-4e19-87f8-851ea2552d77 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:26.425406 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-25b965d9-54ae-4e19-87f8-851ea2552d77 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:26.432574 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-25b965d9-54ae-4e19-87f8-851ea2552d77 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:26.433068 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-25b965d9-54ae-4e19-87f8-851ea2552d77 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:26.433491 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-25b965d9-54ae-4e19-87f8-851ea2552d77 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:26.434173 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-25b965d9-54ae-4e19-87f8-851ea2552d77 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:26.434609 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-25b965d9-54ae-4e19-87f8-851ea2552d77 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:26.435021 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-25b965d9-54ae-4e19-87f8-851ea2552d77 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:26.652274 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-25b965d9-54ae-4e19-87f8-851ea2552d77 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:26.664824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-25b965d9-54ae-4e19-87f8-851ea2552d77 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.244354 Aug 22 05:41:26.665843 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 221/432] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:26 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:26.911858 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:41:26.912309 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:41:26.912719 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:41:26.913112 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:41:26.913659 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:41:26.922972 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:26.923444 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:26.924021 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:26.924726 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:26.925164 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:26.925572 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:26.942596 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Getting quotas for project 8cadb48afce14e758bfe62771530527a. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:41:26.949720 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Getting quotas for user 9643b0f10e8345889c181efbb1978237 and project 8cadb48afce14e758bfe62771530527a. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:41:26.961062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:41:26.963471 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:41:27.014757 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4c6ca3fa-eb67-4fb2-80d9-d8c6b84cad4a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.774109 Aug 22 05:41:27.019735 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 212/433] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:41:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:41:27.026992 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b5aa6ba8-74a3-46d2-a6c4-0019047d837e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:27.028166 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b5aa6ba8-74a3-46d2-a6c4-0019047d837e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:27.122210 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b5aa6ba8-74a3-46d2-a6c4-0019047d837e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:27.131014 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b5aa6ba8-74a3-46d2-a6c4-0019047d837e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1245 microversion: 2.1 time: 0.107796 Aug 22 05:41:27.144295 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 222/434] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:27 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1245 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:27.164367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9cbea92a-93f0-4031-8035-2f1fbd0614ba tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:27.165022 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9cbea92a-93f0-4031-8035-2f1fbd0614ba tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:27.179947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9cbea92a-93f0-4031-8035-2f1fbd0614ba tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:27.184293 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9cbea92a-93f0-4031-8035-2f1fbd0614ba tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:27.185016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9cbea92a-93f0-4031-8035-2f1fbd0614ba tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:27.186329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9cbea92a-93f0-4031-8035-2f1fbd0614ba tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:27.188140 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9cbea92a-93f0-4031-8035-2f1fbd0614ba tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:27.188715 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9cbea92a-93f0-4031-8035-2f1fbd0614ba tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:27.417000 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9cbea92a-93f0-4031-8035-2f1fbd0614ba tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:27.428336 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9cbea92a-93f0-4031-8035-2f1fbd0614ba tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1503 microversion: 2.1 time: 0.271150 Aug 22 05:41:27.429452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 213/435] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:27 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1503 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:27.687015 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-602a2a36-9d06-4678-9ea8-bb9b9c0c812d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:27.687838 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-602a2a36-9d06-4678-9ea8-bb9b9c0c812d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:27.719710 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-602a2a36-9d06-4678-9ea8-bb9b9c0c812d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:27.721579 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-602a2a36-9d06-4678-9ea8-bb9b9c0c812d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:27.723879 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-602a2a36-9d06-4678-9ea8-bb9b9c0c812d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:27.724727 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-602a2a36-9d06-4678-9ea8-bb9b9c0c812d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:27.726359 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-602a2a36-9d06-4678-9ea8-bb9b9c0c812d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:27.729153 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-602a2a36-9d06-4678-9ea8-bb9b9c0c812d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:28.033188 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-602a2a36-9d06-4678-9ea8-bb9b9c0c812d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:28.043754 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-602a2a36-9d06-4678-9ea8-bb9b9c0c812d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.360726 Aug 22 05:41:28.044559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 223/436] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:27 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:28.076672 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-8db3a9ce-6df5-4be9-9b4a-07091e793a4e req-30c3ce5f-f92a-412f-8e5d-60a86f7bfd31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4295082-964b-4620-8ffc-6fc6078058fe", "name": "network-vif-deleted", "tag": "6a146665-b5bf-4c78-8623-a3e873c3f0ad"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:28.092450 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-8db3a9ce-6df5-4be9-9b4a-07091e793a4e req-30c3ce5f-f92a-412f-8e5d-60a86f7bfd31 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:28.093325 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-8db3a9ce-6df5-4be9-9b4a-07091e793a4e req-30c3ce5f-f92a-412f-8e5d-60a86f7bfd31 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:28.094165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-8db3a9ce-6df5-4be9-9b4a-07091e793a4e req-30c3ce5f-f92a-412f-8e5d-60a86f7bfd31 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:28.105788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-8db3a9ce-6df5-4be9-9b4a-07091e793a4e req-30c3ce5f-f92a-412f-8e5d-60a86f7bfd31 service nova] Creating event network-vif-deleted:6a146665-b5bf-4c78-8623-a3e873c3f0ad for instance f4295082-964b-4620-8ffc-6fc6078058fe on hv-cinder-85391 Aug 22 05:41:28.111122 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-8db3a9ce-6df5-4be9-9b4a-07091e793a4e req-30c3ce5f-f92a-412f-8e5d-60a86f7bfd31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039219 Aug 22 05:41:28.111800 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 214/437] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:41:28.155785 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-2d56978b-8e39-40d8-972b-560787acb4fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:28.157809 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-2d56978b-8e39-40d8-972b-560787acb4fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:28.166389 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2d56978b-8e39-40d8-972b-560787acb4fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:28.166874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2d56978b-8e39-40d8-972b-560787acb4fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:28.167300 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2d56978b-8e39-40d8-972b-560787acb4fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:28.168262 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2d56978b-8e39-40d8-972b-560787acb4fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:28.168801 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2d56978b-8e39-40d8-972b-560787acb4fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:28.169323 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2d56978b-8e39-40d8-972b-560787acb4fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:28.192179 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-aed3e3dd-75f0-49df-86f0-0f6bbbd6078e req-22798197-0e5d-4d8f-b82f-2afb0c13ec42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3283723-b1fc-4306-9005-cea7f9cf01de", "tag": "916df34e-02ee-4d26-8fba-49d48b0f2ee6"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:28.225972 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-aed3e3dd-75f0-49df-86f0-0f6bbbd6078e req-22798197-0e5d-4d8f-b82f-2afb0c13ec42 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:28.226457 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-aed3e3dd-75f0-49df-86f0-0f6bbbd6078e req-22798197-0e5d-4d8f-b82f-2afb0c13ec42 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:28.226871 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-aed3e3dd-75f0-49df-86f0-0f6bbbd6078e req-22798197-0e5d-4d8f-b82f-2afb0c13ec42 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:28.245984 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-2d56978b-8e39-40d8-972b-560787acb4fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:28.256480 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-aed3e3dd-75f0-49df-86f0-0f6bbbd6078e req-22798197-0e5d-4d8f-b82f-2afb0c13ec42 service nova] Creating event network-changed:916df34e-02ee-4d26-8fba-49d48b0f2ee6 for instance a3283723-b1fc-4306-9005-cea7f9cf01de on hv-cinder-85391 Aug 22 05:41:28.259061 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-2d56978b-8e39-40d8-972b-560787acb4fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1297 microversion: 2.1 time: 0.109713 Aug 22 05:41:28.259904 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 224/438] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:28 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1297 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:28.276786 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-aed3e3dd-75f0-49df-86f0-0f6bbbd6078e req-22798197-0e5d-4d8f-b82f-2afb0c13ec42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094967 Aug 22 05:41:28.277938 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 215/439] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:41:28.449684 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-76502cf5-6fa6-4842-b34e-be12232e87b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:28.450298 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-76502cf5-6fa6-4842-b34e-be12232e87b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:28.456434 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-76502cf5-6fa6-4842-b34e-be12232e87b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:28.456912 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-76502cf5-6fa6-4842-b34e-be12232e87b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:28.457322 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-76502cf5-6fa6-4842-b34e-be12232e87b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:28.458006 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-76502cf5-6fa6-4842-b34e-be12232e87b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:28.458452 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-76502cf5-6fa6-4842-b34e-be12232e87b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:28.458868 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-76502cf5-6fa6-4842-b34e-be12232e87b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:28.490589 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-76502cf5-6fa6-4842-b34e-be12232e87b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:28.491063 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-76502cf5-6fa6-4842-b34e-be12232e87b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:28.491495 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-76502cf5-6fa6-4842-b34e-be12232e87b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:28.491959 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.objects.instance [None req-76502cf5-6fa6-4842-b34e-be12232e87b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lazy-loading 'fault' on Instance uuid f4295082-964b-4620-8ffc-6fc6078058fe {{(pid=132497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:41:28.534830 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-76502cf5-6fa6-4842-b34e-be12232e87b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf99219df4fb45a4b7ec5fea537f8be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375a7cf8cbc042a187f2b144d907c175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:28.543065 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-76502cf5-6fa6-4842-b34e-be12232e87b7 tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 200 len: 1303 microversion: 2.1 time: 0.097335 Aug 22 05:41:28.543615 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 225/440] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:28 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:29.068429 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-42a280a3-92cd-4cc0-9c20-2f12e5f66866 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:29.082495 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-42a280a3-92cd-4cc0-9c20-2f12e5f66866 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:29.082495 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42a280a3-92cd-4cc0-9c20-2f12e5f66866 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:29.082495 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42a280a3-92cd-4cc0-9c20-2f12e5f66866 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:29.082495 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42a280a3-92cd-4cc0-9c20-2f12e5f66866 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:29.083342 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42a280a3-92cd-4cc0-9c20-2f12e5f66866 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:29.083342 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42a280a3-92cd-4cc0-9c20-2f12e5f66866 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:29.083342 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42a280a3-92cd-4cc0-9c20-2f12e5f66866 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:29.288337 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b94cc7e6-95a4-492a-8915-e7516645b45e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:29.288992 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b94cc7e6-95a4-492a-8915-e7516645b45e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:29.295629 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b94cc7e6-95a4-492a-8915-e7516645b45e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:29.296369 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b94cc7e6-95a4-492a-8915-e7516645b45e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:29.296922 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b94cc7e6-95a4-492a-8915-e7516645b45e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:29.297630 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b94cc7e6-95a4-492a-8915-e7516645b45e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:29.298216 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b94cc7e6-95a4-492a-8915-e7516645b45e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:29.298639 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b94cc7e6-95a4-492a-8915-e7516645b45e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:29.314847 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-42a280a3-92cd-4cc0-9c20-2f12e5f66866 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:29.332167 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-42a280a3-92cd-4cc0-9c20-2f12e5f66866 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.268370 Aug 22 05:41:29.334529 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 216/441] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:29 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:29.548945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b94cc7e6-95a4-492a-8915-e7516645b45e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:29.558169 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b94cc7e6-95a4-492a-8915-e7516645b45e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.273626 Aug 22 05:41:29.565746 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-862a2c7b-9cae-432f-aa92-b27c5a8e3fea tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:29.566669 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-862a2c7b-9cae-432f-aa92-b27c5a8e3fea tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] [instance: f4295082-964b-4620-8ffc-6fc6078058fe] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:29.568723 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 226/442] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:29 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:29.572900 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-862a2c7b-9cae-432f-aa92-b27c5a8e3fea tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:29.584267 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-862a2c7b-9cae-432f-aa92-b27c5a8e3fea tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:29.584665 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-862a2c7b-9cae-432f-aa92-b27c5a8e3fea tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:29.588850 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-862a2c7b-9cae-432f-aa92-b27c5a8e3fea tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:29.589315 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-862a2c7b-9cae-432f-aa92-b27c5a8e3fea tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:29.589734 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-862a2c7b-9cae-432f-aa92-b27c5a8e3fea tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:29.611877 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-862a2c7b-9cae-432f-aa92-b27c5a8e3fea tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] HTTP exception thrown: Instance f4295082-964b-4620-8ffc-6fc6078058fe could not be found. Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-862a2c7b-9cae-432f-aa92-b27c5a8e3fea tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Request method failure captured: Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe HTTP/1.1 Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxbDWMY-c24Iqiivl9eknkNZ2S10LEeOXG8ML0Ne4AGVQsLDDTtF3d-a4sI-aRpjpA9_CYLw5b88HQH1Kr7aGldtx9b-5sVaozc0DCOSw8aPJiLA9UaO9DW25sjLay7yHSeysiSfTGDelVQ37A-tTDaWiTAAP3DvbgIpxjJqSCKVnXQ Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 375a7cf8cbc042a187f2b144d907c175 Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesActionsTest-669076233 Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:41:29.613557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:41:29.614844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_375a7cf8cbc042a187f2b144d907c175", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/375a7cf8cbc042a187f2b144d907c175"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/375a7cf8cbc042a187f2b144d907c175"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/375a7cf8cbc042a187f2b144d907c175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:41:29.614844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesActionsTest-669076233 Aug 22 05:41:29.614844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 375a7cf8cbc042a187f2b144d907c175 Aug 22 05:41:29.614844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesActionsTest-669076233 Aug 22 05:41:29.614844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesActionsTest-669076233-project Aug 22 05:41:29.614844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:41:29.614844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:41:29.614844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: bf99219df4fb45a4b7ec5fea537f8be2 Aug 22 05:41:29.614844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesActionsTest-669076233-project Aug 22 05:41:29.614844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:41:29.614844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance f4295082-964b-4620-8ffc-6fc6078058fe could not be found. Aug 22 05:41:29.614844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': 'f4295082-964b-4620-8ffc-6fc6078058fe'} Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4295082-964b-4620-8ffc-6fc6078058fe could not be found. Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:41:29.615628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4295082-964b-4620-8ffc-6fc6078058fe could not be found. Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4295082-964b-4620-8ffc-6fc6078058fe could not be found. Aug 22 05:41:29.616849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:41:29.617920 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-862a2c7b-9cae-432f-aa92-b27c5a8e3fea tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] Returning 404 to user: Instance f4295082-964b-4620-8ffc-6fc6078058fe could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:41:29.617920 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-862a2c7b-9cae-432f-aa92-b27c5a8e3fea tempest-VolumesActionsTest-669076233 tempest-VolumesActionsTest-669076233-project] 10.222.0.18 "GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe" status: 404 len: 111 microversion: 2.1 time: 0.053849 Aug 22 05:41:29.617920 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 217/443] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:29 2022] GET /compute/v2.1/servers/f4295082-964b-4620-8ffc-6fc6078058fe => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:41:30.361260 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-33af23c5-faa5-4610-a36c-8b5340546d7e tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:30.361895 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-33af23c5-faa5-4610-a36c-8b5340546d7e tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:30.370518 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-33af23c5-faa5-4610-a36c-8b5340546d7e tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:30.371158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-33af23c5-faa5-4610-a36c-8b5340546d7e tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:30.371829 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-33af23c5-faa5-4610-a36c-8b5340546d7e tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:30.372914 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-33af23c5-faa5-4610-a36c-8b5340546d7e tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:30.373609 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-33af23c5-faa5-4610-a36c-8b5340546d7e tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:30.374223 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-33af23c5-faa5-4610-a36c-8b5340546d7e tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:30.512148 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-33af23c5-faa5-4610-a36c-8b5340546d7e tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:30.523382 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-33af23c5-faa5-4610-a36c-8b5340546d7e tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.165734 Aug 22 05:41:30.524220 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 227/444] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:30 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:30.579304 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-eee510fc-4ea6-4358-b55a-723c5ef2fd01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:30.579904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-eee510fc-4ea6-4358-b55a-723c5ef2fd01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:30.586345 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eee510fc-4ea6-4358-b55a-723c5ef2fd01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:30.586852 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eee510fc-4ea6-4358-b55a-723c5ef2fd01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:30.587277 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eee510fc-4ea6-4358-b55a-723c5ef2fd01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:30.587982 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eee510fc-4ea6-4358-b55a-723c5ef2fd01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:30.588427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eee510fc-4ea6-4358-b55a-723c5ef2fd01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:30.588842 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eee510fc-4ea6-4358-b55a-723c5ef2fd01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:30.730399 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-eee510fc-4ea6-4358-b55a-723c5ef2fd01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:30.738428 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-eee510fc-4ea6-4358-b55a-723c5ef2fd01 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.163246 Aug 22 05:41:30.739068 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 218/445] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:30 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:31.544986 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-916381c8-893f-454f-9534-a74d1a5da50a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:31.545562 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-916381c8-893f-454f-9534-a74d1a5da50a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:31.552540 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-916381c8-893f-454f-9534-a74d1a5da50a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:31.553013 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-916381c8-893f-454f-9534-a74d1a5da50a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:31.553431 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-916381c8-893f-454f-9534-a74d1a5da50a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:31.554103 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-916381c8-893f-454f-9534-a74d1a5da50a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:31.554546 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-916381c8-893f-454f-9534-a74d1a5da50a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:31.554979 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-916381c8-893f-454f-9534-a74d1a5da50a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:31.696652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-916381c8-893f-454f-9534-a74d1a5da50a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:31.709260 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-916381c8-893f-454f-9534-a74d1a5da50a tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.167891 Aug 22 05:41:31.710191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 228/446] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:31 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:31.759245 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c4ac259d-2eb7-4ee2-8764-21611c924a57 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:31.759848 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c4ac259d-2eb7-4ee2-8764-21611c924a57 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:31.766335 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4ac259d-2eb7-4ee2-8764-21611c924a57 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:31.766808 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4ac259d-2eb7-4ee2-8764-21611c924a57 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:31.767232 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4ac259d-2eb7-4ee2-8764-21611c924a57 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:31.767962 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4ac259d-2eb7-4ee2-8764-21611c924a57 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:31.768406 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4ac259d-2eb7-4ee2-8764-21611c924a57 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:31.768816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4ac259d-2eb7-4ee2-8764-21611c924a57 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:31.907231 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c4ac259d-2eb7-4ee2-8764-21611c924a57 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:31.909794 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:31.916788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c4ac259d-2eb7-4ee2-8764-21611c924a57 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.161310 Aug 22 05:41:31.917639 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 219/447] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:31 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:32.738745 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-05147f6f-9928-4bc4-b96b-494c9205bc04 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:32.739401 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-05147f6f-9928-4bc4-b96b-494c9205bc04 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:32.749776 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-05147f6f-9928-4bc4-b96b-494c9205bc04 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:32.750582 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-05147f6f-9928-4bc4-b96b-494c9205bc04 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:32.751031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-05147f6f-9928-4bc4-b96b-494c9205bc04 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:32.751750 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-05147f6f-9928-4bc4-b96b-494c9205bc04 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:32.752248 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-05147f6f-9928-4bc4-b96b-494c9205bc04 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:32.752660 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-05147f6f-9928-4bc4-b96b-494c9205bc04 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:32.889410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-05147f6f-9928-4bc4-b96b-494c9205bc04 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:32.898326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-05147f6f-9928-4bc4-b96b-494c9205bc04 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.166415 Aug 22 05:41:32.899123 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 229/448] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:32 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:32.938875 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7a986785-d62c-439e-bbe1-79b9d24e3f2a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:32.939400 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7a986785-d62c-439e-bbe1-79b9d24e3f2a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:32.946111 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7a986785-d62c-439e-bbe1-79b9d24e3f2a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:32.946619 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7a986785-d62c-439e-bbe1-79b9d24e3f2a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:32.947046 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7a986785-d62c-439e-bbe1-79b9d24e3f2a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:32.947757 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7a986785-d62c-439e-bbe1-79b9d24e3f2a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:32.948275 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7a986785-d62c-439e-bbe1-79b9d24e3f2a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:32.948726 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7a986785-d62c-439e-bbe1-79b9d24e3f2a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:33.083464 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7a986785-d62c-439e-bbe1-79b9d24e3f2a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:33.091282 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7a986785-d62c-439e-bbe1-79b9d24e3f2a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.157151 Aug 22 05:41:33.092165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 220/449] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:32 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:33.922916 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-1449bb5d-3967-485e-8ee3-5e09134fa369 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:33.923510 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-1449bb5d-3967-485e-8ee3-5e09134fa369 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:33.930433 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1449bb5d-3967-485e-8ee3-5e09134fa369 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:33.930907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1449bb5d-3967-485e-8ee3-5e09134fa369 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:33.931331 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1449bb5d-3967-485e-8ee3-5e09134fa369 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:33.932060 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1449bb5d-3967-485e-8ee3-5e09134fa369 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:33.932501 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1449bb5d-3967-485e-8ee3-5e09134fa369 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:33.932914 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1449bb5d-3967-485e-8ee3-5e09134fa369 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:34.071791 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-1449bb5d-3967-485e-8ee3-5e09134fa369 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:34.079970 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-1449bb5d-3967-485e-8ee3-5e09134fa369 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.161292 Aug 22 05:41:34.080538 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 230/450] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:33 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:34.113129 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0f6fdaab-8022-4a83-82b8-9df68c30ccc2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:34.113730 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0f6fdaab-8022-4a83-82b8-9df68c30ccc2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:34.120059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f6fdaab-8022-4a83-82b8-9df68c30ccc2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:34.120530 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f6fdaab-8022-4a83-82b8-9df68c30ccc2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:34.120958 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f6fdaab-8022-4a83-82b8-9df68c30ccc2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:34.121633 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f6fdaab-8022-4a83-82b8-9df68c30ccc2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:34.122072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f6fdaab-8022-4a83-82b8-9df68c30ccc2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:34.122487 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f6fdaab-8022-4a83-82b8-9df68c30ccc2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:34.265667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0f6fdaab-8022-4a83-82b8-9df68c30ccc2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:34.273546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0f6fdaab-8022-4a83-82b8-9df68c30ccc2 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.164542 Aug 22 05:41:34.274217 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 221/451] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:34 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:35.101405 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-d734822d-f791-427d-b4f3-1f84e5a5d3c3 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:35.102009 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-d734822d-f791-427d-b4f3-1f84e5a5d3c3 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:35.108865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d734822d-f791-427d-b4f3-1f84e5a5d3c3 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:35.109347 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d734822d-f791-427d-b4f3-1f84e5a5d3c3 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:35.109779 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d734822d-f791-427d-b4f3-1f84e5a5d3c3 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:35.111128 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d734822d-f791-427d-b4f3-1f84e5a5d3c3 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:35.111560 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d734822d-f791-427d-b4f3-1f84e5a5d3c3 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:35.112032 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d734822d-f791-427d-b4f3-1f84e5a5d3c3 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:35.131242 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=100 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:35.255622 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-d734822d-f791-427d-b4f3-1f84e5a5d3c3 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:35.268242 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-d734822d-f791-427d-b4f3-1f84e5a5d3c3 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.170671 Aug 22 05:41:35.268815 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 231/452] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:35 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:35.297116 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e4b964c4-e0af-473b-b946-09c10cb8028f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:35.298696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e4b964c4-e0af-473b-b946-09c10cb8028f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:35.305369 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e4b964c4-e0af-473b-b946-09c10cb8028f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:35.305852 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e4b964c4-e0af-473b-b946-09c10cb8028f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:35.306308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e4b964c4-e0af-473b-b946-09c10cb8028f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:35.306992 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e4b964c4-e0af-473b-b946-09c10cb8028f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:35.307435 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e4b964c4-e0af-473b-b946-09c10cb8028f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:35.307911 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e4b964c4-e0af-473b-b946-09c10cb8028f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:35.453259 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e4b964c4-e0af-473b-b946-09c10cb8028f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:35.461281 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e4b964c4-e0af-473b-b946-09c10cb8028f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.170284 Aug 22 05:41:35.461980 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 222/453] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:35 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:36.299860 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f5008bce-b391-49dc-9895-18a61f6674d6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:36.300457 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f5008bce-b391-49dc-9895-18a61f6674d6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:36.307180 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f5008bce-b391-49dc-9895-18a61f6674d6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:36.307692 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f5008bce-b391-49dc-9895-18a61f6674d6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:36.308118 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f5008bce-b391-49dc-9895-18a61f6674d6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:36.308834 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f5008bce-b391-49dc-9895-18a61f6674d6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:36.309239 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f5008bce-b391-49dc-9895-18a61f6674d6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:36.309652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f5008bce-b391-49dc-9895-18a61f6674d6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:36.454454 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-f5008bce-b391-49dc-9895-18a61f6674d6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:36.465194 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f5008bce-b391-49dc-9895-18a61f6674d6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.171231 Aug 22 05:41:36.466180 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 232/454] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:36 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:36.484016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5756fcd4-6459-49d2-a6f6-7f120b5fde8f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:36.484639 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5756fcd4-6459-49d2-a6f6-7f120b5fde8f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:36.491800 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5756fcd4-6459-49d2-a6f6-7f120b5fde8f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:36.492279 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5756fcd4-6459-49d2-a6f6-7f120b5fde8f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:36.492709 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5756fcd4-6459-49d2-a6f6-7f120b5fde8f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:36.493395 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5756fcd4-6459-49d2-a6f6-7f120b5fde8f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:36.493841 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5756fcd4-6459-49d2-a6f6-7f120b5fde8f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:36.494257 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5756fcd4-6459-49d2-a6f6-7f120b5fde8f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:36.633968 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5756fcd4-6459-49d2-a6f6-7f120b5fde8f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:36.642068 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5756fcd4-6459-49d2-a6f6-7f120b5fde8f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.163069 Aug 22 05:41:36.642673 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 223/455] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:36 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:37.493978 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-19808905-590e-486e-8b75-07da02ae937d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:37.494592 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-19808905-590e-486e-8b75-07da02ae937d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:37.496813 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=8 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:37.503966 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19808905-590e-486e-8b75-07da02ae937d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:37.504449 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19808905-590e-486e-8b75-07da02ae937d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:37.504879 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19808905-590e-486e-8b75-07da02ae937d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:37.505571 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19808905-590e-486e-8b75-07da02ae937d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:37.506022 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19808905-590e-486e-8b75-07da02ae937d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:37.506444 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19808905-590e-486e-8b75-07da02ae937d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:37.651166 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-19808905-590e-486e-8b75-07da02ae937d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:37.659053 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-19808905-590e-486e-8b75-07da02ae937d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.170091 Aug 22 05:41:37.659939 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 233/456] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:37 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:37.663488 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5a0e4dd7-1dc6-49b9-9bf8-0c7748cb62e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:37.664121 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5a0e4dd7-1dc6-49b9-9bf8-0c7748cb62e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:37.667241 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=4 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:37.668078 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=12 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:37.672276 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a0e4dd7-1dc6-49b9-9bf8-0c7748cb62e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:37.672762 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a0e4dd7-1dc6-49b9-9bf8-0c7748cb62e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:37.673198 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a0e4dd7-1dc6-49b9-9bf8-0c7748cb62e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:37.674364 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a0e4dd7-1dc6-49b9-9bf8-0c7748cb62e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:37.675136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a0e4dd7-1dc6-49b9-9bf8-0c7748cb62e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:37.675731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a0e4dd7-1dc6-49b9-9bf8-0c7748cb62e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:37.816191 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5a0e4dd7-1dc6-49b9-9bf8-0c7748cb62e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:37.824562 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5a0e4dd7-1dc6-49b9-9bf8-0c7748cb62e0 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.164766 Aug 22 05:41:37.838310 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 224/457] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:37 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:38.681489 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-679e263c-4016-412e-a204-43b67a1fe196 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:38.683085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-679e263c-4016-412e-a204-43b67a1fe196 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:38.696168 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-679e263c-4016-412e-a204-43b67a1fe196 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:38.696581 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-679e263c-4016-412e-a204-43b67a1fe196 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:38.697217 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-679e263c-4016-412e-a204-43b67a1fe196 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:38.698101 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-679e263c-4016-412e-a204-43b67a1fe196 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:38.698698 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-679e263c-4016-412e-a204-43b67a1fe196 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:38.700841 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-679e263c-4016-412e-a204-43b67a1fe196 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:38.853326 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-82e335eb-66c0-4afa-9aef-93b0e2ce6d25 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:38.854544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-82e335eb-66c0-4afa-9aef-93b0e2ce6d25 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:38.869239 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-82e335eb-66c0-4afa-9aef-93b0e2ce6d25 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:38.883911 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-82e335eb-66c0-4afa-9aef-93b0e2ce6d25 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:38.884818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-82e335eb-66c0-4afa-9aef-93b0e2ce6d25 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:38.885813 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-82e335eb-66c0-4afa-9aef-93b0e2ce6d25 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:38.886433 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-82e335eb-66c0-4afa-9aef-93b0e2ce6d25 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:38.887018 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-82e335eb-66c0-4afa-9aef-93b0e2ce6d25 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:38.938887 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-679e263c-4016-412e-a204-43b67a1fe196 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:38.951873 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-679e263c-4016-412e-a204-43b67a1fe196 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.274685 Aug 22 05:41:38.952655 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 234/458] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:38 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:38.982861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-a7539cd9-41c9-4b2c-be0b-10fdc2a6af71 req-cab271df-10df-44e9-8535-06b3b0d55064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c93cef-e688-4d2c-ad3d-508c12c362f3", "tag": "fb44f91d-f5a9-4ec3-a7db-e4802e8c7620"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:38.997290 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-a7539cd9-41c9-4b2c-be0b-10fdc2a6af71 req-cab271df-10df-44e9-8535-06b3b0d55064 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:39.013431 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-a7539cd9-41c9-4b2c-be0b-10fdc2a6af71 req-cab271df-10df-44e9-8535-06b3b0d55064 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:39.013431 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-a7539cd9-41c9-4b2c-be0b-10fdc2a6af71 req-cab271df-10df-44e9-8535-06b3b0d55064 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:39.016232 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-a7539cd9-41c9-4b2c-be0b-10fdc2a6af71 req-cab271df-10df-44e9-8535-06b3b0d55064 service nova] Creating event network-changed:fb44f91d-f5a9-4ec3-a7db-e4802e8c7620 for instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 on hv-cinder-85391 Aug 22 05:41:39.022755 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-a7539cd9-41c9-4b2c-be0b-10fdc2a6af71 req-cab271df-10df-44e9-8535-06b3b0d55064 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067655 Aug 22 05:41:39.024118 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 235/459] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:41:39.184811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-82e335eb-66c0-4afa-9aef-93b0e2ce6d25 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:39.194867 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-82e335eb-66c0-4afa-9aef-93b0e2ce6d25 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.351487 Aug 22 05:41:39.196275 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 225/460] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:38 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:39.676653 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-33cec557-18a1-4e93-8e8f-fcff3a66331c req-91e2c931-39d6-430d-ab02-0db6599baf51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3283723-b1fc-4306-9005-cea7f9cf01de", "name": "network-vif-plugged", "status": "completed", "tag": "916df34e-02ee-4d26-8fba-49d48b0f2ee6"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:39.693762 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-33cec557-18a1-4e93-8e8f-fcff3a66331c req-91e2c931-39d6-430d-ab02-0db6599baf51 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:39.695026 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-33cec557-18a1-4e93-8e8f-fcff3a66331c req-91e2c931-39d6-430d-ab02-0db6599baf51 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:39.697690 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-33cec557-18a1-4e93-8e8f-fcff3a66331c req-91e2c931-39d6-430d-ab02-0db6599baf51 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:39.719301 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-33cec557-18a1-4e93-8e8f-fcff3a66331c req-91e2c931-39d6-430d-ab02-0db6599baf51 service nova] Creating event network-vif-plugged:916df34e-02ee-4d26-8fba-49d48b0f2ee6 for instance a3283723-b1fc-4306-9005-cea7f9cf01de on hv-cinder-85391 Aug 22 05:41:39.728415 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-33cec557-18a1-4e93-8e8f-fcff3a66331c req-91e2c931-39d6-430d-ab02-0db6599baf51 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058488 Aug 22 05:41:39.730080 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 236/461] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:41:39.978485 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fb151a62-929e-4d05-8b4c-47b065a67922 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:39.979943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fb151a62-929e-4d05-8b4c-47b065a67922 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:39.988206 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb151a62-929e-4d05-8b4c-47b065a67922 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:39.988968 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb151a62-929e-4d05-8b4c-47b065a67922 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:39.989523 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb151a62-929e-4d05-8b4c-47b065a67922 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:39.990527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb151a62-929e-4d05-8b4c-47b065a67922 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:39.991094 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb151a62-929e-4d05-8b4c-47b065a67922 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:39.991978 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb151a62-929e-4d05-8b4c-47b065a67922 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:40.147596 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fb151a62-929e-4d05-8b4c-47b065a67922 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:40.157908 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fb151a62-929e-4d05-8b4c-47b065a67922 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.184372 Aug 22 05:41:40.158667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 226/462] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:39 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:40.220597 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-432ba0db-7f9f-4369-94c4-76ea19106a9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:40.221874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-432ba0db-7f9f-4369-94c4-76ea19106a9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:40.231958 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-432ba0db-7f9f-4369-94c4-76ea19106a9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:40.233459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-432ba0db-7f9f-4369-94c4-76ea19106a9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:40.234300 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-432ba0db-7f9f-4369-94c4-76ea19106a9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:40.235179 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-432ba0db-7f9f-4369-94c4-76ea19106a9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:40.236656 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-432ba0db-7f9f-4369-94c4-76ea19106a9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:40.237924 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-432ba0db-7f9f-4369-94c4-76ea19106a9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:40.416756 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-432ba0db-7f9f-4369-94c4-76ea19106a9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:40.430648 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-432ba0db-7f9f-4369-94c4-76ea19106a9b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.215915 Aug 22 05:41:40.443597 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 237/463] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:40 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:41.181772 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-30921ed6-bacc-4775-8a24-9238ab8906ab tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:41.183473 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-30921ed6-bacc-4775-8a24-9238ab8906ab tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:41.192096 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-30921ed6-bacc-4775-8a24-9238ab8906ab tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:41.192833 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-30921ed6-bacc-4775-8a24-9238ab8906ab tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:41.193355 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-30921ed6-bacc-4775-8a24-9238ab8906ab tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:41.194061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-30921ed6-bacc-4775-8a24-9238ab8906ab tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:41.194507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-30921ed6-bacc-4775-8a24-9238ab8906ab tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:41.194927 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-30921ed6-bacc-4775-8a24-9238ab8906ab tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:41.363412 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-30921ed6-bacc-4775-8a24-9238ab8906ab tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:41.377034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-30921ed6-bacc-4775-8a24-9238ab8906ab tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.201666 Aug 22 05:41:41.379663 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 227/464] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:41 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:41.468486 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a940cba1-cfc8-4a8e-bf90-ba2e5e9315ff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:41.469120 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a940cba1-cfc8-4a8e-bf90-ba2e5e9315ff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:41.471209 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:41.477379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a940cba1-cfc8-4a8e-bf90-ba2e5e9315ff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:41.477883 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a940cba1-cfc8-4a8e-bf90-ba2e5e9315ff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:41.478316 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a940cba1-cfc8-4a8e-bf90-ba2e5e9315ff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:41.479022 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a940cba1-cfc8-4a8e-bf90-ba2e5e9315ff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:41.479472 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a940cba1-cfc8-4a8e-bf90-ba2e5e9315ff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:41.480083 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a940cba1-cfc8-4a8e-bf90-ba2e5e9315ff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:41.631421 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a940cba1-cfc8-4a8e-bf90-ba2e5e9315ff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:41.639422 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a940cba1-cfc8-4a8e-bf90-ba2e5e9315ff tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.181465 Aug 22 05:41:41.640166 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 238/465] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:41 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:42.404568 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4f639109-c09b-4fd4-8ea2-80c2b94c97f8 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:42.404568 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4f639109-c09b-4fd4-8ea2-80c2b94c97f8 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:42.414489 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4f639109-c09b-4fd4-8ea2-80c2b94c97f8 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:42.415507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4f639109-c09b-4fd4-8ea2-80c2b94c97f8 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:42.416951 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4f639109-c09b-4fd4-8ea2-80c2b94c97f8 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:42.417877 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4f639109-c09b-4fd4-8ea2-80c2b94c97f8 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:42.418349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4f639109-c09b-4fd4-8ea2-80c2b94c97f8 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:42.418798 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4f639109-c09b-4fd4-8ea2-80c2b94c97f8 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:42.572478 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4f639109-c09b-4fd4-8ea2-80c2b94c97f8 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:42.584100 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4f639109-c09b-4fd4-8ea2-80c2b94c97f8 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.188667 Aug 22 05:41:42.584995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 228/466] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:42 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:42.665203 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-06c3bf97-9f06-4381-9849-196de94b3ee6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:42.666551 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-06c3bf97-9f06-4381-9849-196de94b3ee6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:42.673689 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06c3bf97-9f06-4381-9849-196de94b3ee6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:42.675481 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06c3bf97-9f06-4381-9849-196de94b3ee6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:42.675968 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06c3bf97-9f06-4381-9849-196de94b3ee6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:42.676889 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06c3bf97-9f06-4381-9849-196de94b3ee6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:42.677319 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06c3bf97-9f06-4381-9849-196de94b3ee6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:42.677731 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06c3bf97-9f06-4381-9849-196de94b3ee6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:42.849523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-06c3bf97-9f06-4381-9849-196de94b3ee6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:42.860643 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-06c3bf97-9f06-4381-9849-196de94b3ee6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.202655 Aug 22 05:41:42.861536 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 239/467] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:42 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:43.263552 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2118409133", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-364360750", "security_groups": [{"name": "tempest-secgroup-smoke-1896911709"}], "networks": [{"uuid": "7672c5ff-5132-4eb0-8f88-3cedac478625"}], "block_device_mapping_v2": [{"uuid": "9e26cdf7-1afc-407b-b2bd-7866d94b583d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:43.426982 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] validate_networks() for [('7672c5ff-5132-4eb0-8f88-3cedac478625', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:41:43.608620 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-9de9d824-92e9-4449-adfd-e3a697ee79e0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:43.609603 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-9de9d824-92e9-4449-adfd-e3a697ee79e0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:43.617270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9de9d824-92e9-4449-adfd-e3a697ee79e0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:43.618048 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9de9d824-92e9-4449-adfd-e3a697ee79e0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:43.618661 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9de9d824-92e9-4449-adfd-e3a697ee79e0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:43.619720 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9de9d824-92e9-4449-adfd-e3a697ee79e0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:43.620366 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9de9d824-92e9-4449-adfd-e3a697ee79e0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:43.620966 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9de9d824-92e9-4449-adfd-e3a697ee79e0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:43.870836 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-9de9d824-92e9-4449-adfd-e3a697ee79e0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:43.881129 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-9de9d824-92e9-4449-adfd-e3a697ee79e0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.277475 Aug 22 05:41:43.882289 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 240/468] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:43 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:43.888143 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-683b510a-de57-4afd-be25-ff1baca2305b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:43.889624 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-683b510a-de57-4afd-be25-ff1baca2305b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:43.903032 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-683b510a-de57-4afd-be25-ff1baca2305b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:43.903527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-683b510a-de57-4afd-be25-ff1baca2305b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:43.906135 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-683b510a-de57-4afd-be25-ff1baca2305b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:43.906792 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-683b510a-de57-4afd-be25-ff1baca2305b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:43.907264 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-683b510a-de57-4afd-be25-ff1baca2305b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:43.907688 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-683b510a-de57-4afd-be25-ff1baca2305b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:44.014999 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:41:44.015432 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:41:44.016231 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:41:44.017554 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:41:44.018528 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:41:44.035942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:44.037054 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:44.038212 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:44.040411 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:44.041235 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:44.041836 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:44.063102 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Getting quotas for project 638a0c07a94f43d4807931639fd6a93e. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:41:44.068005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Getting quotas for user f4010e99c30b4a49b19c6b8fa2b5f7f2 and project 638a0c07a94f43d4807931639fd6a93e. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:41:44.113527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-683b510a-de57-4afd-be25-ff1baca2305b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:44.121704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-683b510a-de57-4afd-be25-ff1baca2305b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.238032 Aug 22 05:41:44.122457 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 241/469] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:43 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:44.142010 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:41:44.144378 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e26cdf7-1afc-407b-b2bd-7866d94b583d',volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:41:44.326132 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f15c8415-a3bc-42b9-9481-a2b7a751ef23 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.067500 Aug 22 05:41:44.327665 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 229/470] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:41:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:41:44.343922 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-61c4eff8-8027-4530-892f-4422b5da3aa8 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:44.345077 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-61c4eff8-8027-4530-892f-4422b5da3aa8 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:44.421128 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-61c4eff8-8027-4530-892f-4422b5da3aa8 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:44.429554 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-61c4eff8-8027-4530-892f-4422b5da3aa8 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1088 microversion: 2.1 time: 0.094098 Aug 22 05:41:44.433949 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 242/471] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:44 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1088 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:44.903775 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c236f277-3de9-4503-9ca0-a02ad3e3a308 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:44.904997 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c236f277-3de9-4503-9ca0-a02ad3e3a308 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:44.916326 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c236f277-3de9-4503-9ca0-a02ad3e3a308 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:44.917018 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c236f277-3de9-4503-9ca0-a02ad3e3a308 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:44.917618 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c236f277-3de9-4503-9ca0-a02ad3e3a308 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:44.918466 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c236f277-3de9-4503-9ca0-a02ad3e3a308 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:44.919059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c236f277-3de9-4503-9ca0-a02ad3e3a308 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:44.920036 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c236f277-3de9-4503-9ca0-a02ad3e3a308 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:45.055364 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c236f277-3de9-4503-9ca0-a02ad3e3a308 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:45.063435 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c236f277-3de9-4503-9ca0-a02ad3e3a308 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.164970 Aug 22 05:41:45.064591 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 230/472] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:44 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:45.145581 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e2f82e9b-ba69-4fe6-8312-93ad582f1189 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:45.146827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e2f82e9b-ba69-4fe6-8312-93ad582f1189 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:45.153520 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2f82e9b-ba69-4fe6-8312-93ad582f1189 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:45.154258 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2f82e9b-ba69-4fe6-8312-93ad582f1189 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:45.154894 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2f82e9b-ba69-4fe6-8312-93ad582f1189 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:45.155903 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2f82e9b-ba69-4fe6-8312-93ad582f1189 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:45.156350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2f82e9b-ba69-4fe6-8312-93ad582f1189 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:45.156762 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2f82e9b-ba69-4fe6-8312-93ad582f1189 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:45.311977 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e2f82e9b-ba69-4fe6-8312-93ad582f1189 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:45.325671 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e2f82e9b-ba69-4fe6-8312-93ad582f1189 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.184536 Aug 22 05:41:45.326871 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 243/473] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:45 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:45.458382 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d2a11823-cf05-44bd-80f2-e02def85075e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:45.458965 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d2a11823-cf05-44bd-80f2-e02def85075e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:45.465627 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2a11823-cf05-44bd-80f2-e02def85075e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:45.466099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2a11823-cf05-44bd-80f2-e02def85075e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:45.466520 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2a11823-cf05-44bd-80f2-e02def85075e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:45.467559 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2a11823-cf05-44bd-80f2-e02def85075e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:45.468004 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2a11823-cf05-44bd-80f2-e02def85075e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:45.468636 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2a11823-cf05-44bd-80f2-e02def85075e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:45.534320 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d2a11823-cf05-44bd-80f2-e02def85075e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:45.542826 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d2a11823-cf05-44bd-80f2-e02def85075e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1138 microversion: 2.1 time: 0.088026 Aug 22 05:41:45.555763 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 231/474] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:45 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1138 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:46.087982 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c46715ff-02cb-4f2e-a545-005053217e9d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:46.088504 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c46715ff-02cb-4f2e-a545-005053217e9d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:46.094974 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c46715ff-02cb-4f2e-a545-005053217e9d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:46.095451 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c46715ff-02cb-4f2e-a545-005053217e9d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:46.095906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c46715ff-02cb-4f2e-a545-005053217e9d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:46.097215 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c46715ff-02cb-4f2e-a545-005053217e9d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:46.097780 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c46715ff-02cb-4f2e-a545-005053217e9d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:46.098195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c46715ff-02cb-4f2e-a545-005053217e9d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:46.316025 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c46715ff-02cb-4f2e-a545-005053217e9d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:46.325612 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c46715ff-02cb-4f2e-a545-005053217e9d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.244990 Aug 22 05:41:46.339966 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 244/475] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:46 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:46.348565 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-dd809bc2-8137-405c-b23e-2ace1709fe0a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:46.349947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-dd809bc2-8137-405c-b23e-2ace1709fe0a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:46.357575 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd809bc2-8137-405c-b23e-2ace1709fe0a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:46.358423 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd809bc2-8137-405c-b23e-2ace1709fe0a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:46.359087 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd809bc2-8137-405c-b23e-2ace1709fe0a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:46.360072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd809bc2-8137-405c-b23e-2ace1709fe0a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:46.360878 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd809bc2-8137-405c-b23e-2ace1709fe0a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:46.361514 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd809bc2-8137-405c-b23e-2ace1709fe0a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:46.554059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-dd809bc2-8137-405c-b23e-2ace1709fe0a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:46.565484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-dd809bc2-8137-405c-b23e-2ace1709fe0a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.220897 Aug 22 05:41:46.566674 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 232/476] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:46 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:46.583736 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7b5d1c30-14d6-4f0b-b1a6-0c322b437b59 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:46.584594 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-7b5d1c30-14d6-4f0b-b1a6-0c322b437b59 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:46.593699 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7b5d1c30-14d6-4f0b-b1a6-0c322b437b59 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:46.594121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7b5d1c30-14d6-4f0b-b1a6-0c322b437b59 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:46.594767 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7b5d1c30-14d6-4f0b-b1a6-0c322b437b59 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:46.595777 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7b5d1c30-14d6-4f0b-b1a6-0c322b437b59 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:46.596887 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7b5d1c30-14d6-4f0b-b1a6-0c322b437b59 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:46.597389 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7b5d1c30-14d6-4f0b-b1a6-0c322b437b59 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:46.682713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-7b5d1c30-14d6-4f0b-b1a6-0c322b437b59 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:46.691322 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-7b5d1c30-14d6-4f0b-b1a6-0c322b437b59 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1138 microversion: 2.1 time: 0.128849 Aug 22 05:41:46.692535 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 245/477] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:46 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1138 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:47.348474 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1d2f3faa-9574-43ec-b0cb-77ba9bc8f46d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:47.349091 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1d2f3faa-9574-43ec-b0cb-77ba9bc8f46d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:47.356071 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d2f3faa-9574-43ec-b0cb-77ba9bc8f46d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:47.356561 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d2f3faa-9574-43ec-b0cb-77ba9bc8f46d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:47.356984 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d2f3faa-9574-43ec-b0cb-77ba9bc8f46d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:47.357682 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d2f3faa-9574-43ec-b0cb-77ba9bc8f46d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:47.358145 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d2f3faa-9574-43ec-b0cb-77ba9bc8f46d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:47.358568 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d2f3faa-9574-43ec-b0cb-77ba9bc8f46d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:47.519432 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1d2f3faa-9574-43ec-b0cb-77ba9bc8f46d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:47.528169 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1d2f3faa-9574-43ec-b0cb-77ba9bc8f46d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.183672 Aug 22 05:41:47.528944 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 233/478] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:47 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:47.590155 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6b1834d2-9c7b-4671-9bf5-382caa3690c7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:47.591894 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-6b1834d2-9c7b-4671-9bf5-382caa3690c7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:47.598605 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6b1834d2-9c7b-4671-9bf5-382caa3690c7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:47.599272 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6b1834d2-9c7b-4671-9bf5-382caa3690c7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:47.599878 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6b1834d2-9c7b-4671-9bf5-382caa3690c7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:47.600778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6b1834d2-9c7b-4671-9bf5-382caa3690c7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:47.601389 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6b1834d2-9c7b-4671-9bf5-382caa3690c7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:47.601644 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6b1834d2-9c7b-4671-9bf5-382caa3690c7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:47.726536 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3862579d-2b9d-4f6c-9833-2387c1d6c500 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:47.726536 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3862579d-2b9d-4f6c-9833-2387c1d6c500 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:47.726536 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3862579d-2b9d-4f6c-9833-2387c1d6c500 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:47.726536 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3862579d-2b9d-4f6c-9833-2387c1d6c500 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:47.727131 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3862579d-2b9d-4f6c-9833-2387c1d6c500 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:47.732412 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3862579d-2b9d-4f6c-9833-2387c1d6c500 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:47.733113 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3862579d-2b9d-4f6c-9833-2387c1d6c500 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:47.734005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3862579d-2b9d-4f6c-9833-2387c1d6c500 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:47.783290 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6b1834d2-9c7b-4671-9bf5-382caa3690c7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:47.799094 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6b1834d2-9c7b-4671-9bf5-382caa3690c7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.212703 Aug 22 05:41:47.805940 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 246/479] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:47 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:47.840337 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3862579d-2b9d-4f6c-9833-2387c1d6c500 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:47.851486 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3862579d-2b9d-4f6c-9833-2387c1d6c500 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1138 microversion: 2.1 time: 0.140520 Aug 22 05:41:47.864093 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 234/480] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:47 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1138 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:48.550939 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-12914eb7-d0ed-4de4-9a45-c4624e70a8c0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:48.552420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-12914eb7-d0ed-4de4-9a45-c4624e70a8c0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:48.562974 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-12914eb7-d0ed-4de4-9a45-c4624e70a8c0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:48.564007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-12914eb7-d0ed-4de4-9a45-c4624e70a8c0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:48.564773 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-12914eb7-d0ed-4de4-9a45-c4624e70a8c0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:48.566642 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-12914eb7-d0ed-4de4-9a45-c4624e70a8c0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:48.567703 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-12914eb7-d0ed-4de4-9a45-c4624e70a8c0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:48.567957 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-12914eb7-d0ed-4de4-9a45-c4624e70a8c0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:48.769748 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-12914eb7-d0ed-4de4-9a45-c4624e70a8c0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:48.792105 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-12914eb7-d0ed-4de4-9a45-c4624e70a8c0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.247112 Aug 22 05:41:48.793107 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 247/481] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:48 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:48.827554 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-00bd7c2a-ffd0-4f47-b608-77b5b9996f67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:48.829038 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-00bd7c2a-ffd0-4f47-b608-77b5b9996f67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:48.837756 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00bd7c2a-ffd0-4f47-b608-77b5b9996f67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:48.838335 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00bd7c2a-ffd0-4f47-b608-77b5b9996f67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:48.838849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00bd7c2a-ffd0-4f47-b608-77b5b9996f67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:48.839636 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00bd7c2a-ffd0-4f47-b608-77b5b9996f67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:48.840144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00bd7c2a-ffd0-4f47-b608-77b5b9996f67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:48.843327 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00bd7c2a-ffd0-4f47-b608-77b5b9996f67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:48.881612 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-24341755-7091-4d9b-aa2f-58d2e20d9828 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:48.882717 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-24341755-7091-4d9b-aa2f-58d2e20d9828 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:48.899042 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-24341755-7091-4d9b-aa2f-58d2e20d9828 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:48.899042 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-24341755-7091-4d9b-aa2f-58d2e20d9828 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:48.899042 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-24341755-7091-4d9b-aa2f-58d2e20d9828 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:48.899042 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-24341755-7091-4d9b-aa2f-58d2e20d9828 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:48.899502 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-24341755-7091-4d9b-aa2f-58d2e20d9828 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:48.899502 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-24341755-7091-4d9b-aa2f-58d2e20d9828 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:49.068154 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-24341755-7091-4d9b-aa2f-58d2e20d9828 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:49.080572 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-24341755-7091-4d9b-aa2f-58d2e20d9828 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1186 microversion: 2.1 time: 0.203373 Aug 22 05:41:49.092222 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 248/482] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:48 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1186 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:49.129869 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-00bd7c2a-ffd0-4f47-b608-77b5b9996f67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:49.139423 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-00bd7c2a-ffd0-4f47-b608-77b5b9996f67 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.317093 Aug 22 05:41:49.140125 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 235/483] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:48 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:49.817611 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-35826466-fb7e-4cdc-b5a7-d28d22a432de tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:49.818244 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-35826466-fb7e-4cdc-b5a7-d28d22a432de tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:49.834796 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-35826466-fb7e-4cdc-b5a7-d28d22a432de tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:49.835294 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-35826466-fb7e-4cdc-b5a7-d28d22a432de tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:49.835757 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-35826466-fb7e-4cdc-b5a7-d28d22a432de tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:49.836512 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-35826466-fb7e-4cdc-b5a7-d28d22a432de tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:49.836968 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-35826466-fb7e-4cdc-b5a7-d28d22a432de tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:49.837391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-35826466-fb7e-4cdc-b5a7-d28d22a432de tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:50.074427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-35826466-fb7e-4cdc-b5a7-d28d22a432de tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:50.084703 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-35826466-fb7e-4cdc-b5a7-d28d22a432de tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1315 microversion: 2.1 time: 0.270933 Aug 22 05:41:50.093275 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 249/484] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:49 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:50.110072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4a549ab4-4851-46a0-8d60-6126c6f536cb tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:50.110698 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4a549ab4-4851-46a0-8d60-6126c6f536cb tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:50.119016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4a549ab4-4851-46a0-8d60-6126c6f536cb tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:50.119537 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4a549ab4-4851-46a0-8d60-6126c6f536cb tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:50.120596 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4a549ab4-4851-46a0-8d60-6126c6f536cb tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:50.121507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4a549ab4-4851-46a0-8d60-6126c6f536cb tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:50.121976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4a549ab4-4851-46a0-8d60-6126c6f536cb tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:50.122440 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4a549ab4-4851-46a0-8d60-6126c6f536cb tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:50.162592 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-2208bf4c-f576-47b4-9fa9-c2672f1c9ac6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:50.163197 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-2208bf4c-f576-47b4-9fa9-c2672f1c9ac6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:50.170746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2208bf4c-f576-47b4-9fa9-c2672f1c9ac6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:50.174535 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2208bf4c-f576-47b4-9fa9-c2672f1c9ac6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:50.175744 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2208bf4c-f576-47b4-9fa9-c2672f1c9ac6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:50.176891 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2208bf4c-f576-47b4-9fa9-c2672f1c9ac6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:50.177677 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2208bf4c-f576-47b4-9fa9-c2672f1c9ac6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:50.178623 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2208bf4c-f576-47b4-9fa9-c2672f1c9ac6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:50.207602 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=100 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:50.241161 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4a549ab4-4851-46a0-8d60-6126c6f536cb tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:50.254519 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4a549ab4-4851-46a0-8d60-6126c6f536cb tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1186 microversion: 2.1 time: 0.148469 Aug 22 05:41:50.255468 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 236/485] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:50 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1186 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:50.541929 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-2208bf4c-f576-47b4-9fa9-c2672f1c9ac6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:50.550091 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-2208bf4c-f576-47b4-9fa9-c2672f1c9ac6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.391396 Aug 22 05:41:50.550714 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 250/486] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:50 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:50.724175 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-e1224ccb-977e-429d-b564-7b1fbae2d44a req-d63fe0ef-a3d9-44af-a95d-715d55411ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c93cef-e688-4d2c-ad3d-508c12c362f3", "name": "network-vif-plugged", "status": "completed", "tag": "fb44f91d-f5a9-4ec3-a7db-e4802e8c7620"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:50.748970 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-e1224ccb-977e-429d-b564-7b1fbae2d44a req-d63fe0ef-a3d9-44af-a95d-715d55411ef9 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:50.750028 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-e1224ccb-977e-429d-b564-7b1fbae2d44a req-d63fe0ef-a3d9-44af-a95d-715d55411ef9 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:50.751662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-e1224ccb-977e-429d-b564-7b1fbae2d44a req-d63fe0ef-a3d9-44af-a95d-715d55411ef9 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:50.766067 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:50.779910 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-e1224ccb-977e-429d-b564-7b1fbae2d44a req-d63fe0ef-a3d9-44af-a95d-715d55411ef9 service nova] Creating event network-vif-plugged:fb44f91d-f5a9-4ec3-a7db-e4802e8c7620 for instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 on hv-cinder-85391 Aug 22 05:41:50.788584 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-e1224ccb-977e-429d-b564-7b1fbae2d44a req-d63fe0ef-a3d9-44af-a95d-715d55411ef9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069180 Aug 22 05:41:50.789723 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 237/487] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:41:51.117406 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-2aff6660-963a-4cd6-92da-2cb7e5db97b0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:51.119439 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-2aff6660-963a-4cd6-92da-2cb7e5db97b0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:51.150637 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2aff6660-963a-4cd6-92da-2cb7e5db97b0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:51.152491 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2aff6660-963a-4cd6-92da-2cb7e5db97b0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:51.153580 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2aff6660-963a-4cd6-92da-2cb7e5db97b0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:51.155493 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2aff6660-963a-4cd6-92da-2cb7e5db97b0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:51.156193 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2aff6660-963a-4cd6-92da-2cb7e5db97b0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:51.157119 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2aff6660-963a-4cd6-92da-2cb7e5db97b0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:51.283290 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c7383da8-e9a9-4ae3-99ce-0642fbb623b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:51.285117 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c7383da8-e9a9-4ae3-99ce-0642fbb623b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:51.301215 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c7383da8-e9a9-4ae3-99ce-0642fbb623b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:51.301860 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c7383da8-e9a9-4ae3-99ce-0642fbb623b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:51.302988 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c7383da8-e9a9-4ae3-99ce-0642fbb623b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:51.305211 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c7383da8-e9a9-4ae3-99ce-0642fbb623b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:51.306831 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c7383da8-e9a9-4ae3-99ce-0642fbb623b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:51.307356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c7383da8-e9a9-4ae3-99ce-0642fbb623b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:51.435981 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-2aff6660-963a-4cd6-92da-2cb7e5db97b0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:51.452033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-2aff6660-963a-4cd6-92da-2cb7e5db97b0 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1465 microversion: 2.1 time: 0.343336 Aug 22 05:41:51.472465 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 251/488] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:51 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1465 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:51.518719 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ee276a7c-35c5-4f67-9317-c714928e1d7b tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:51.519389 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ee276a7c-35c5-4f67-9317-c714928e1d7b tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:51.531539 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ee276a7c-35c5-4f67-9317-c714928e1d7b tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:51.532435 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ee276a7c-35c5-4f67-9317-c714928e1d7b tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:51.533040 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ee276a7c-35c5-4f67-9317-c714928e1d7b tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:51.534684 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ee276a7c-35c5-4f67-9317-c714928e1d7b tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:51.535364 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ee276a7c-35c5-4f67-9317-c714928e1d7b tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:51.536019 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ee276a7c-35c5-4f67-9317-c714928e1d7b tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:51.574951 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ee276a7c-35c5-4f67-9317-c714928e1d7b tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Going to try to terminate instance {{(pid=132497) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:41:51.707213 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ee276a7c-35c5-4f67-9317-c714928e1d7b tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 204 len: 0 microversion: 2.1 time: 0.189554 Aug 22 05:41:51.709188 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 252/489] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:41:51 2022] DELETE /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 05:41:51.719510 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-73c77da9-c93a-487c-b046-5c71f43692fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:51.721376 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-73c77da9-c93a-487c-b046-5c71f43692fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:51.732513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-73c77da9-c93a-487c-b046-5c71f43692fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:51.733364 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-73c77da9-c93a-487c-b046-5c71f43692fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:51.733965 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-73c77da9-c93a-487c-b046-5c71f43692fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:51.734993 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-73c77da9-c93a-487c-b046-5c71f43692fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:51.735642 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-73c77da9-c93a-487c-b046-5c71f43692fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:51.736227 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-73c77da9-c93a-487c-b046-5c71f43692fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:51.865370 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c7383da8-e9a9-4ae3-99ce-0642fbb623b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:51.882915 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c7383da8-e9a9-4ae3-99ce-0642fbb623b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1204 microversion: 2.1 time: 0.600818 Aug 22 05:41:51.906444 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 238/490] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:51 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1204 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:51.932280 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c4f0aefa-9237-4ce9-a1b8-9e45fc8fd4ca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:51.935107 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c4f0aefa-9237-4ce9-a1b8-9e45fc8fd4ca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:51.937366 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:51.958819 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4f0aefa-9237-4ce9-a1b8-9e45fc8fd4ca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:51.959241 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4f0aefa-9237-4ce9-a1b8-9e45fc8fd4ca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:51.959710 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4f0aefa-9237-4ce9-a1b8-9e45fc8fd4ca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:51.960440 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4f0aefa-9237-4ce9-a1b8-9e45fc8fd4ca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:51.960888 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4f0aefa-9237-4ce9-a1b8-9e45fc8fd4ca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:51.961311 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4f0aefa-9237-4ce9-a1b8-9e45fc8fd4ca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:51.984250 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-73c77da9-c93a-487c-b046-5c71f43692fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:52.002630 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-73c77da9-c93a-487c-b046-5c71f43692fc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.289079 Aug 22 05:41:52.005853 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 253/491] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:51 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:52.183998 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c4f0aefa-9237-4ce9-a1b8-9e45fc8fd4ca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:52.194087 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c4f0aefa-9237-4ce9-a1b8-9e45fc8fd4ca tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1471 microversion: 2.1 time: 0.286436 Aug 22 05:41:52.195357 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 239/492] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:51 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1471 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:52.914592 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-68ad0968-d69d-45ae-b77c-fddd7208d7be tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:52.915255 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-68ad0968-d69d-45ae-b77c-fddd7208d7be tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:52.922960 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-68ad0968-d69d-45ae-b77c-fddd7208d7be tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:52.923466 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-68ad0968-d69d-45ae-b77c-fddd7208d7be tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:52.923924 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-68ad0968-d69d-45ae-b77c-fddd7208d7be tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:52.924767 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-68ad0968-d69d-45ae-b77c-fddd7208d7be tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:52.925263 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-68ad0968-d69d-45ae-b77c-fddd7208d7be tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:52.925721 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-68ad0968-d69d-45ae-b77c-fddd7208d7be tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:53.029391 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-675cdfdf-5b2d-4cd5-afb3-be7c837a2d60 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:53.030927 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-675cdfdf-5b2d-4cd5-afb3-be7c837a2d60 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:53.044048 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-675cdfdf-5b2d-4cd5-afb3-be7c837a2d60 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:53.044831 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-675cdfdf-5b2d-4cd5-afb3-be7c837a2d60 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:53.045388 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-675cdfdf-5b2d-4cd5-afb3-be7c837a2d60 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:53.046368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-675cdfdf-5b2d-4cd5-afb3-be7c837a2d60 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:53.047079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-675cdfdf-5b2d-4cd5-afb3-be7c837a2d60 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:53.050197 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-675cdfdf-5b2d-4cd5-afb3-be7c837a2d60 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:53.123955 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-68ad0968-d69d-45ae-b77c-fddd7208d7be tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:53.139518 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-68ad0968-d69d-45ae-b77c-fddd7208d7be tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1272 microversion: 2.1 time: 0.229342 Aug 22 05:41:53.152644 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 254/493] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:52 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1272 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:53.218598 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5a229452-d263-4a72-8f34-18f5aced1de6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:53.219828 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5a229452-d263-4a72-8f34-18f5aced1de6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:53.229979 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a229452-d263-4a72-8f34-18f5aced1de6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:53.230542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a229452-d263-4a72-8f34-18f5aced1de6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:53.231071 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a229452-d263-4a72-8f34-18f5aced1de6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:53.231867 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a229452-d263-4a72-8f34-18f5aced1de6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:53.233169 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a229452-d263-4a72-8f34-18f5aced1de6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:53.233169 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a229452-d263-4a72-8f34-18f5aced1de6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:53.266965 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-675cdfdf-5b2d-4cd5-afb3-be7c837a2d60 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:53.285661 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-675cdfdf-5b2d-4cd5-afb3-be7c837a2d60 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.262909 Aug 22 05:41:53.294272 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 240/494] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:53 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:53.518501 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5a229452-d263-4a72-8f34-18f5aced1de6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:53.528710 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5a229452-d263-4a72-8f34-18f5aced1de6 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1471 microversion: 2.1 time: 0.315443 Aug 22 05:41:53.529377 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 255/495] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:53 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:53.736299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-2aed6030-715b-4331-91af-615e0b14f3e3 req-6f4eeca7-300c-454e-901b-0111b78bc460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57433a27-1ab9-4b19-b87b-fc2c80644b94", "tag": "d68e991c-9283-490b-b88a-5d68f84a5bd6"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:53.746864 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-2aed6030-715b-4331-91af-615e0b14f3e3 req-6f4eeca7-300c-454e-901b-0111b78bc460 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:53.747638 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-2aed6030-715b-4331-91af-615e0b14f3e3 req-6f4eeca7-300c-454e-901b-0111b78bc460 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:53.748258 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-2aed6030-715b-4331-91af-615e0b14f3e3 req-6f4eeca7-300c-454e-901b-0111b78bc460 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:53.761154 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-2aed6030-715b-4331-91af-615e0b14f3e3 req-6f4eeca7-300c-454e-901b-0111b78bc460 service nova] Creating event network-changed:d68e991c-9283-490b-b88a-5d68f84a5bd6 for instance 57433a27-1ab9-4b19-b87b-fc2c80644b94 on hv-cinder-85391 Aug 22 05:41:53.766323 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-2aed6030-715b-4331-91af-615e0b14f3e3 req-6f4eeca7-300c-454e-901b-0111b78bc460 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033822 Aug 22 05:41:53.767546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 241/496] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:41:54.162508 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-931471da-7641-4373-a81a-a8ae30729e9d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:54.163276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-931471da-7641-4373-a81a-a8ae30729e9d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:54.170729 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-931471da-7641-4373-a81a-a8ae30729e9d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:54.171220 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-931471da-7641-4373-a81a-a8ae30729e9d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:54.171677 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-931471da-7641-4373-a81a-a8ae30729e9d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:54.172380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-931471da-7641-4373-a81a-a8ae30729e9d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:54.172859 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-931471da-7641-4373-a81a-a8ae30729e9d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:54.173332 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-931471da-7641-4373-a81a-a8ae30729e9d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:54.318150 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-158d6342-4648-4896-aa3f-5cf54d66c34e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:54.318848 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-158d6342-4648-4896-aa3f-5cf54d66c34e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:54.321179 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:54.322044 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=6 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:54.328718 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-158d6342-4648-4896-aa3f-5cf54d66c34e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:54.329373 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-158d6342-4648-4896-aa3f-5cf54d66c34e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:54.329859 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-158d6342-4648-4896-aa3f-5cf54d66c34e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:54.330500 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-931471da-7641-4373-a81a-a8ae30729e9d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:54.330959 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-158d6342-4648-4896-aa3f-5cf54d66c34e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:54.331422 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-158d6342-4648-4896-aa3f-5cf54d66c34e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:54.331873 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-158d6342-4648-4896-aa3f-5cf54d66c34e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:54.342691 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-931471da-7641-4373-a81a-a8ae30729e9d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.184163 Aug 22 05:41:54.343870 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 256/497] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:54 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:54.504300 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-158d6342-4648-4896-aa3f-5cf54d66c34e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:54.516799 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-158d6342-4648-4896-aa3f-5cf54d66c34e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.203075 Aug 22 05:41:54.530675 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 242/498] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:54 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:54.550594 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8777ea5e-1ce7-4fa0-b30c-a5fd615cc467 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:54.551218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8777ea5e-1ce7-4fa0-b30c-a5fd615cc467 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:54.554515 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=2 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:54.560719 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8777ea5e-1ce7-4fa0-b30c-a5fd615cc467 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:54.561211 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8777ea5e-1ce7-4fa0-b30c-a5fd615cc467 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:54.562020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8777ea5e-1ce7-4fa0-b30c-a5fd615cc467 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:54.562899 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8777ea5e-1ce7-4fa0-b30c-a5fd615cc467 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:54.563499 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8777ea5e-1ce7-4fa0-b30c-a5fd615cc467 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:54.564129 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8777ea5e-1ce7-4fa0-b30c-a5fd615cc467 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:54.827407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8777ea5e-1ce7-4fa0-b30c-a5fd615cc467 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:54.839483 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8777ea5e-1ce7-4fa0-b30c-a5fd615cc467 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1471 microversion: 2.1 time: 0.293079 Aug 22 05:41:54.840426 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 257/499] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:54 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1471 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:55.364796 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-df873e57-b0c9-4326-a6cc-00da43d630ec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:55.365428 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-df873e57-b0c9-4326-a6cc-00da43d630ec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:55.379743 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-df873e57-b0c9-4326-a6cc-00da43d630ec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:55.380600 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-df873e57-b0c9-4326-a6cc-00da43d630ec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:55.381344 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-df873e57-b0c9-4326-a6cc-00da43d630ec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:55.382259 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-df873e57-b0c9-4326-a6cc-00da43d630ec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:55.382865 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-df873e57-b0c9-4326-a6cc-00da43d630ec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:55.383808 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-df873e57-b0c9-4326-a6cc-00da43d630ec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:55.542715 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-98e2ab55-7015-4384-a48f-1423ed483175 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:55.543196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-98e2ab55-7015-4384-a48f-1423ed483175 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:55.559698 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-98e2ab55-7015-4384-a48f-1423ed483175 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:55.567660 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-98e2ab55-7015-4384-a48f-1423ed483175 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:55.569452 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-98e2ab55-7015-4384-a48f-1423ed483175 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:55.571383 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-98e2ab55-7015-4384-a48f-1423ed483175 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:55.573527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-98e2ab55-7015-4384-a48f-1423ed483175 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:55.575857 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-98e2ab55-7015-4384-a48f-1423ed483175 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:55.673380 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-df873e57-b0c9-4326-a6cc-00da43d630ec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:55.681466 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-df873e57-b0c9-4326-a6cc-00da43d630ec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.321128 Aug 22 05:41:55.682042 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 243/500] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:55 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:55.742615 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-98e2ab55-7015-4384-a48f-1423ed483175 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:55.751315 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-98e2ab55-7015-4384-a48f-1423ed483175 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1371 microversion: 2.1 time: 0.215303 Aug 22 05:41:55.752435 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 258/501] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:55 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:55.791765 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-8b5b5392-6fbd-40b1-97cb-ad993db9e8c6 req-fe96646f-bed9-41f8-aa48-738cdd855e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3283723-b1fc-4306-9005-cea7f9cf01de", "name": "network-vif-deleted", "tag": "916df34e-02ee-4d26-8fba-49d48b0f2ee6"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:55.802133 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-8b5b5392-6fbd-40b1-97cb-ad993db9e8c6 req-fe96646f-bed9-41f8-aa48-738cdd855e02 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:55.802690 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-8b5b5392-6fbd-40b1-97cb-ad993db9e8c6 req-fe96646f-bed9-41f8-aa48-738cdd855e02 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:55.803137 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-8b5b5392-6fbd-40b1-97cb-ad993db9e8c6 req-fe96646f-bed9-41f8-aa48-738cdd855e02 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:55.814696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-8b5b5392-6fbd-40b1-97cb-ad993db9e8c6 req-fe96646f-bed9-41f8-aa48-738cdd855e02 service nova] Creating event network-vif-deleted:916df34e-02ee-4d26-8fba-49d48b0f2ee6 for instance a3283723-b1fc-4306-9005-cea7f9cf01de on hv-cinder-85391 Aug 22 05:41:55.820313 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-8b5b5392-6fbd-40b1-97cb-ad993db9e8c6 req-fe96646f-bed9-41f8-aa48-738cdd855e02 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031802 Aug 22 05:41:55.821173 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 244/502] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:41:55.863280 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-eecd6971-5461-4cb6-8222-162613810bc4 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:55.864073 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-eecd6971-5461-4cb6-8222-162613810bc4 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:55.870428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-eecd6971-5461-4cb6-8222-162613810bc4 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:55.870908 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-eecd6971-5461-4cb6-8222-162613810bc4 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:55.871339 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-eecd6971-5461-4cb6-8222-162613810bc4 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:55.872068 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-eecd6971-5461-4cb6-8222-162613810bc4 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:55.872515 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-eecd6971-5461-4cb6-8222-162613810bc4 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:55.872951 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-eecd6971-5461-4cb6-8222-162613810bc4 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:55.905267 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-eecd6971-5461-4cb6-8222-162613810bc4 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:55.905793 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-eecd6971-5461-4cb6-8222-162613810bc4 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:55.906406 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-eecd6971-5461-4cb6-8222-162613810bc4 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:55.906940 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.objects.instance [None req-eecd6971-5461-4cb6-8222-162613810bc4 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lazy-loading 'fault' on Instance uuid a3283723-b1fc-4306-9005-cea7f9cf01de {{(pid=132497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:41:55.950545 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-eecd6971-5461-4cb6-8222-162613810bc4 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d09306a85048e19c8b83b787d81877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ba1bb080a9456a9a5b567f33c45bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:55.958983 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-eecd6971-5461-4cb6-8222-162613810bc4 tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 200 len: 1305 microversion: 2.1 time: 0.100431 Aug 22 05:41:55.959552 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 259/503] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:55 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:56.702631 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-755d6af0-1117-4291-bf15-951114c3a368 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:56.703414 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-755d6af0-1117-4291-bf15-951114c3a368 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:56.710898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-755d6af0-1117-4291-bf15-951114c3a368 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:56.711363 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-755d6af0-1117-4291-bf15-951114c3a368 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:56.711828 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-755d6af0-1117-4291-bf15-951114c3a368 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:56.712516 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-755d6af0-1117-4291-bf15-951114c3a368 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:56.712962 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-755d6af0-1117-4291-bf15-951114c3a368 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:56.713376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-755d6af0-1117-4291-bf15-951114c3a368 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:56.773215 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ed98c788-2e9a-441f-b32a-2a9844632954 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:56.773812 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ed98c788-2e9a-441f-b32a-2a9844632954 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:56.780367 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed98c788-2e9a-441f-b32a-2a9844632954 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:56.780837 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed98c788-2e9a-441f-b32a-2a9844632954 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:56.781259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed98c788-2e9a-441f-b32a-2a9844632954 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:56.781944 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed98c788-2e9a-441f-b32a-2a9844632954 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:56.782381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed98c788-2e9a-441f-b32a-2a9844632954 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:56.782794 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed98c788-2e9a-441f-b32a-2a9844632954 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:56.907910 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-755d6af0-1117-4291-bf15-951114c3a368 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:56.916438 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-755d6af0-1117-4291-bf15-951114c3a368 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.217936 Aug 22 05:41:56.917001 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 245/504] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:56 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:56.949896 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ed98c788-2e9a-441f-b32a-2a9844632954 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:56.958036 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ed98c788-2e9a-441f-b32a-2a9844632954 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1565 microversion: 2.1 time: 0.188765 Aug 22 05:41:56.958851 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 260/505] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:56 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:41:56.980163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-81bce128-5422-4403-8f14-f8a76b103143 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:56.980410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e6c8cbf8-6a2e-48b0-8cbf-1246269b401d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:56.980654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-81bce128-5422-4403-8f14-f8a76b103143 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:56.980915 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e6c8cbf8-6a2e-48b0-8cbf-1246269b401d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] [instance: a3283723-b1fc-4306-9005-cea7f9cf01de] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:56.986811 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e6c8cbf8-6a2e-48b0-8cbf-1246269b401d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:56.987261 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-81bce128-5422-4403-8f14-f8a76b103143 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:56.987447 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e6c8cbf8-6a2e-48b0-8cbf-1246269b401d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:56.987808 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e6c8cbf8-6a2e-48b0-8cbf-1246269b401d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:56.987948 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-81bce128-5422-4403-8f14-f8a76b103143 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:56.988248 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-81bce128-5422-4403-8f14-f8a76b103143 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:56.988490 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e6c8cbf8-6a2e-48b0-8cbf-1246269b401d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:56.988937 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-81bce128-5422-4403-8f14-f8a76b103143 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:56.989093 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e6c8cbf8-6a2e-48b0-8cbf-1246269b401d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:56.989381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-81bce128-5422-4403-8f14-f8a76b103143 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:56.989542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e6c8cbf8-6a2e-48b0-8cbf-1246269b401d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:56.989809 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-81bce128-5422-4403-8f14-f8a76b103143 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:57.006838 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-e6c8cbf8-6a2e-48b0-8cbf-1246269b401d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] HTTP exception thrown: Instance a3283723-b1fc-4306-9005-cea7f9cf01de could not be found. Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e6c8cbf8-6a2e-48b0-8cbf-1246269b401d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Request method failure captured: Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de HTTP/1.1 Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxb6KGNL2AOPGIrsQsGBUKY7eLUTHFtoia8khT7RHDBiwUvTFrv9J1D9fUQV2ZqhwVA0HD62M51xLlxXC7tdYVDXppIswGPh7HCM3vVypx5uxwjjWL2qTTxUpaHBcyjFPhprDMAKF-3FJJeEd-Ir-fTFOWpj37ALHFWgVwm5DBDjxOI Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: e0ba1bb080a9456a9a5b567f33c45bd3 Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-VolumesNegativeTest-1487027185 Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:41:57.008521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:41:57.010095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e0ba1bb080a9456a9a5b567f33c45bd3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0ba1bb080a9456a9a5b567f33c45bd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0ba1bb080a9456a9a5b567f33c45bd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e0ba1bb080a9456a9a5b567f33c45bd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:41:57.010095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-VolumesNegativeTest-1487027185 Aug 22 05:41:57.010095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: e0ba1bb080a9456a9a5b567f33c45bd3 Aug 22 05:41:57.010095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-VolumesNegativeTest-1487027185 Aug 22 05:41:57.010095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-VolumesNegativeTest-1487027185-project Aug 22 05:41:57.010095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:41:57.010095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:41:57.010095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: 81d09306a85048e19c8b83b787d81877 Aug 22 05:41:57.010095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-VolumesNegativeTest-1487027185-project Aug 22 05:41:57.010095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:41:57.010095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance a3283723-b1fc-4306-9005-cea7f9cf01de could not be found. Aug 22 05:41:57.010095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': 'a3283723-b1fc-4306-9005-cea7f9cf01de'} Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3283723-b1fc-4306-9005-cea7f9cf01de could not be found. Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:41:57.010945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3283723-b1fc-4306-9005-cea7f9cf01de could not be found. Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3283723-b1fc-4306-9005-cea7f9cf01de could not be found. Aug 22 05:41:57.012228 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:41:57.013302 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e6c8cbf8-6a2e-48b0-8cbf-1246269b401d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] Returning 404 to user: Instance a3283723-b1fc-4306-9005-cea7f9cf01de could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:41:57.013302 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e6c8cbf8-6a2e-48b0-8cbf-1246269b401d tempest-VolumesNegativeTest-1487027185 tempest-VolumesNegativeTest-1487027185-project] 10.222.0.18 "GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de" status: 404 len: 111 microversion: 2.1 time: 0.033504 Aug 22 05:41:57.013302 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 261/506] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:56 2022] GET /compute/v2.1/servers/a3283723-b1fc-4306-9005-cea7f9cf01de => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 05:41:57.079072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-81bce128-5422-4403-8f14-f8a76b103143 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102801 Aug 22 05:41:57.084761 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 246/507] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Aug 22 05:41:56 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:41:57.937366 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b76b9efa-4585-427c-8b2a-4fb50239d3d1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:57.937982 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b76b9efa-4585-427c-8b2a-4fb50239d3d1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:57.944651 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b76b9efa-4585-427c-8b2a-4fb50239d3d1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:57.945135 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b76b9efa-4585-427c-8b2a-4fb50239d3d1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:57.945608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b76b9efa-4585-427c-8b2a-4fb50239d3d1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:57.946439 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b76b9efa-4585-427c-8b2a-4fb50239d3d1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:57.946748 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b76b9efa-4585-427c-8b2a-4fb50239d3d1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:57.947179 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b76b9efa-4585-427c-8b2a-4fb50239d3d1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:58.123272 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-18136db6-fe5a-4d48-b884-8197cfa4d4ab req-24b663c4-4583-43a0-81fe-8ec96a18a4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c93cef-e688-4d2c-ad3d-508c12c362f3", "tag": "fb44f91d-f5a9-4ec3-a7db-e4802e8c7620"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:41:58.135831 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-18136db6-fe5a-4d48-b884-8197cfa4d4ab req-24b663c4-4583-43a0-81fe-8ec96a18a4a0 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:58.136321 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-18136db6-fe5a-4d48-b884-8197cfa4d4ab req-24b663c4-4583-43a0-81fe-8ec96a18a4a0 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:58.136838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-18136db6-fe5a-4d48-b884-8197cfa4d4ab req-24b663c4-4583-43a0-81fe-8ec96a18a4a0 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:58.151411 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-18136db6-fe5a-4d48-b884-8197cfa4d4ab req-24b663c4-4583-43a0-81fe-8ec96a18a4a0 service nova] Creating event network-changed:fb44f91d-f5a9-4ec3-a7db-e4802e8c7620 for instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 on hv-cinder-85391 Aug 22 05:41:58.156981 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-18136db6-fe5a-4d48-b884-8197cfa4d4ab req-24b663c4-4583-43a0-81fe-8ec96a18a4a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043622 Aug 22 05:41:58.157591 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 247/508] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:41:58.221430 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b76b9efa-4585-427c-8b2a-4fb50239d3d1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:58.237178 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b76b9efa-4585-427c-8b2a-4fb50239d3d1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.303213 Aug 22 05:41:58.250783 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 262/509] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:57 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:41:59.272901 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c6ddb59e-55d0-42f6-b946-39493b2fd18b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:41:59.273745 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c6ddb59e-55d0-42f6-b946-39493b2fd18b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:41:59.280442 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6ddb59e-55d0-42f6-b946-39493b2fd18b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:59.280949 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6ddb59e-55d0-42f6-b946-39493b2fd18b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:59.281363 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6ddb59e-55d0-42f6-b946-39493b2fd18b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:59.286438 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6ddb59e-55d0-42f6-b946-39493b2fd18b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:41:59.286888 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6ddb59e-55d0-42f6-b946-39493b2fd18b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:41:59.287343 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6ddb59e-55d0-42f6-b946-39493b2fd18b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:41:59.493953 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c6ddb59e-55d0-42f6-b946-39493b2fd18b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:41:59.505878 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c6ddb59e-55d0-42f6-b946-39493b2fd18b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.251079 Aug 22 05:41:59.506580 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 248/510] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:41:59 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:00.596959 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-da970a04-d201-4068-9f50-6edad610231a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:00.597458 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-da970a04-d201-4068-9f50-6edad610231a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:00.607243 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-da970a04-d201-4068-9f50-6edad610231a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:00.608365 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-da970a04-d201-4068-9f50-6edad610231a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:00.609494 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-da970a04-d201-4068-9f50-6edad610231a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:00.610577 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-da970a04-d201-4068-9f50-6edad610231a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:00.611532 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-da970a04-d201-4068-9f50-6edad610231a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:00.613173 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-da970a04-d201-4068-9f50-6edad610231a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:00.767282 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-da970a04-d201-4068-9f50-6edad610231a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:00.775422 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-da970a04-d201-4068-9f50-6edad610231a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.184918 Aug 22 05:42:00.776016 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 263/511] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:00 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:01.797828 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9d05b845-baff-4804-9995-18b59941a98e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:01.798667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9d05b845-baff-4804-9995-18b59941a98e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:01.805528 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9d05b845-baff-4804-9995-18b59941a98e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:01.806317 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9d05b845-baff-4804-9995-18b59941a98e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:01.806837 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9d05b845-baff-4804-9995-18b59941a98e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:01.807653 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9d05b845-baff-4804-9995-18b59941a98e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:01.808188 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9d05b845-baff-4804-9995-18b59941a98e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:01.808840 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9d05b845-baff-4804-9995-18b59941a98e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:01.959752 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9d05b845-baff-4804-9995-18b59941a98e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:01.970851 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9d05b845-baff-4804-9995-18b59941a98e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.177804 Aug 22 05:42:01.971335 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 249/512] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:01 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:02.992237 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-659b93d2-19b7-4182-824d-3c52d72972a6 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:02.992853 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-659b93d2-19b7-4182-824d-3c52d72972a6 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:02.999862 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-659b93d2-19b7-4182-824d-3c52d72972a6 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:03.000353 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-659b93d2-19b7-4182-824d-3c52d72972a6 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:03.000787 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-659b93d2-19b7-4182-824d-3c52d72972a6 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:03.001486 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-659b93d2-19b7-4182-824d-3c52d72972a6 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:03.001931 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-659b93d2-19b7-4182-824d-3c52d72972a6 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:03.002352 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-659b93d2-19b7-4182-824d-3c52d72972a6 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:03.145510 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-659b93d2-19b7-4182-824d-3c52d72972a6 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:03.153881 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-659b93d2-19b7-4182-824d-3c52d72972a6 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.165563 Aug 22 05:42:03.154389 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 264/513] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:02 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:04.185311 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6c057958-5624-475d-b635-210ab1d31515 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:04.186376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6c057958-5624-475d-b635-210ab1d31515 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:04.195673 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c057958-5624-475d-b635-210ab1d31515 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:04.196106 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c057958-5624-475d-b635-210ab1d31515 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:04.196526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c057958-5624-475d-b635-210ab1d31515 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:04.197205 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c057958-5624-475d-b635-210ab1d31515 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:04.197651 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c057958-5624-475d-b635-210ab1d31515 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:04.198118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c057958-5624-475d-b635-210ab1d31515 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:04.340860 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6c057958-5624-475d-b635-210ab1d31515 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:04.349850 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6c057958-5624-475d-b635-210ab1d31515 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.171423 Aug 22 05:42:04.350265 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 250/514] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:04 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:05.371249 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b0362472-b2e1-450e-9de2-db27b3a88e3e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:05.371858 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b0362472-b2e1-450e-9de2-db27b3a88e3e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:05.378740 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b0362472-b2e1-450e-9de2-db27b3a88e3e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:05.379219 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b0362472-b2e1-450e-9de2-db27b3a88e3e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:05.379655 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b0362472-b2e1-450e-9de2-db27b3a88e3e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:05.380389 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b0362472-b2e1-450e-9de2-db27b3a88e3e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:05.380790 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b0362472-b2e1-450e-9de2-db27b3a88e3e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:05.381358 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b0362472-b2e1-450e-9de2-db27b3a88e3e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:05.529622 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b0362472-b2e1-450e-9de2-db27b3a88e3e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:05.534411 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:05.540124 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b0362472-b2e1-450e-9de2-db27b3a88e3e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.172791 Aug 22 05:42:05.541296 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 265/515] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:05 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:06.560860 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-79b55f10-0868-4f25-8385-edd943810f09 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:06.561418 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-79b55f10-0868-4f25-8385-edd943810f09 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:06.567566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-79b55f10-0868-4f25-8385-edd943810f09 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:06.568094 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-79b55f10-0868-4f25-8385-edd943810f09 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:06.568509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-79b55f10-0868-4f25-8385-edd943810f09 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:06.569212 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-79b55f10-0868-4f25-8385-edd943810f09 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:06.569682 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-79b55f10-0868-4f25-8385-edd943810f09 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:06.570125 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-79b55f10-0868-4f25-8385-edd943810f09 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:06.704519 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-79b55f10-0868-4f25-8385-edd943810f09 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:06.716806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-79b55f10-0868-4f25-8385-edd943810f09 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.159226 Aug 22 05:42:06.717652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 251/516] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:06 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:07.741579 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e07e06fb-414b-457d-ae74-5d1a40ff4107 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:07.742134 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e07e06fb-414b-457d-ae74-5d1a40ff4107 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:07.749517 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e07e06fb-414b-457d-ae74-5d1a40ff4107 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:07.749979 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e07e06fb-414b-457d-ae74-5d1a40ff4107 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:07.750445 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e07e06fb-414b-457d-ae74-5d1a40ff4107 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:07.751127 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e07e06fb-414b-457d-ae74-5d1a40ff4107 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:07.751561 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e07e06fb-414b-457d-ae74-5d1a40ff4107 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:07.752026 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e07e06fb-414b-457d-ae74-5d1a40ff4107 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:07.900702 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e07e06fb-414b-457d-ae74-5d1a40ff4107 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:07.909847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e07e06fb-414b-457d-ae74-5d1a40ff4107 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.174036 Aug 22 05:42:07.910266 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 266/517] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:07 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:08.930674 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bd429cd1-4eb5-4694-9bd8-f2b449a9d112 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:08.931314 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-bd429cd1-4eb5-4694-9bd8-f2b449a9d112 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:08.937631 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd429cd1-4eb5-4694-9bd8-f2b449a9d112 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:08.938109 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd429cd1-4eb5-4694-9bd8-f2b449a9d112 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:08.938537 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd429cd1-4eb5-4694-9bd8-f2b449a9d112 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:08.939227 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd429cd1-4eb5-4694-9bd8-f2b449a9d112 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:08.939699 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd429cd1-4eb5-4694-9bd8-f2b449a9d112 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:08.940115 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd429cd1-4eb5-4694-9bd8-f2b449a9d112 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:09.092709 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-bd429cd1-4eb5-4694-9bd8-f2b449a9d112 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:09.101796 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-bd429cd1-4eb5-4694-9bd8-f2b449a9d112 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.175299 Aug 22 05:42:09.102366 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 252/518] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:08 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:10.126071 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-764bdb65-b915-45b5-bf88-3fd64ff62dec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:10.126902 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-764bdb65-b915-45b5-bf88-3fd64ff62dec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:10.135686 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-764bdb65-b915-45b5-bf88-3fd64ff62dec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:10.136182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-764bdb65-b915-45b5-bf88-3fd64ff62dec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:10.136546 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-764bdb65-b915-45b5-bf88-3fd64ff62dec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:10.137326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-764bdb65-b915-45b5-bf88-3fd64ff62dec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:10.137760 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-764bdb65-b915-45b5-bf88-3fd64ff62dec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:10.138181 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-764bdb65-b915-45b5-bf88-3fd64ff62dec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:10.280135 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-764bdb65-b915-45b5-bf88-3fd64ff62dec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:10.288394 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-764bdb65-b915-45b5-bf88-3fd64ff62dec tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.167533 Aug 22 05:42:10.289065 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 267/519] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:10 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:11.313827 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-83f3ecba-ff5b-4230-90de-e6ea1e78bfd4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:11.314683 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-83f3ecba-ff5b-4230-90de-e6ea1e78bfd4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:11.324927 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83f3ecba-ff5b-4230-90de-e6ea1e78bfd4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:11.325722 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83f3ecba-ff5b-4230-90de-e6ea1e78bfd4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:11.326439 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83f3ecba-ff5b-4230-90de-e6ea1e78bfd4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:11.327610 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83f3ecba-ff5b-4230-90de-e6ea1e78bfd4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:11.328388 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83f3ecba-ff5b-4230-90de-e6ea1e78bfd4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:11.329057 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83f3ecba-ff5b-4230-90de-e6ea1e78bfd4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:11.470101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-83f3ecba-ff5b-4230-90de-e6ea1e78bfd4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:11.481912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-83f3ecba-ff5b-4230-90de-e6ea1e78bfd4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.174513 Aug 22 05:42:11.482463 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 253/520] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:11 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:12.312831 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7eabbb5a-bf0a-42a5-8f78-e0fd3ecec597 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:12.313496 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-7eabbb5a-bf0a-42a5-8f78-e0fd3ecec597 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:12.316237 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:12.323715 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7eabbb5a-bf0a-42a5-8f78-e0fd3ecec597 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:12.324352 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7eabbb5a-bf0a-42a5-8f78-e0fd3ecec597 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:12.324925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7eabbb5a-bf0a-42a5-8f78-e0fd3ecec597 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:12.325831 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7eabbb5a-bf0a-42a5-8f78-e0fd3ecec597 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:12.326427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7eabbb5a-bf0a-42a5-8f78-e0fd3ecec597 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:12.327545 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7eabbb5a-bf0a-42a5-8f78-e0fd3ecec597 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:12.354009 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-7eabbb5a-bf0a-42a5-8f78-e0fd3ecec597 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/ips" status: 200 len: 146 microversion: 2.1 time: 0.046444 Aug 22 05:42:12.354597 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 268/521] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 22 05:42:12 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:42:12.505146 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-01eee560-258b-4c99-8460-a2e8e3df380d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:12.505946 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-01eee560-258b-4c99-8460-a2e8e3df380d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:12.513082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-01eee560-258b-4c99-8460-a2e8e3df380d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:12.513563 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-01eee560-258b-4c99-8460-a2e8e3df380d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:12.513994 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-01eee560-258b-4c99-8460-a2e8e3df380d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:12.514683 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-01eee560-258b-4c99-8460-a2e8e3df380d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:12.515139 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-01eee560-258b-4c99-8460-a2e8e3df380d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:12.515548 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-01eee560-258b-4c99-8460-a2e8e3df380d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:12.650595 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-01eee560-258b-4c99-8460-a2e8e3df380d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:12.658639 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-01eee560-258b-4c99-8460-a2e8e3df380d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.159745 Aug 22 05:42:12.659178 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 254/522] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:12 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:13.683161 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f99cbff2-315b-4d76-bec7-590c5ca9e184 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:13.683749 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f99cbff2-315b-4d76-bec7-590c5ca9e184 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:13.690516 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f99cbff2-315b-4d76-bec7-590c5ca9e184 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:13.690986 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f99cbff2-315b-4d76-bec7-590c5ca9e184 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:13.691412 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f99cbff2-315b-4d76-bec7-590c5ca9e184 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:13.692132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f99cbff2-315b-4d76-bec7-590c5ca9e184 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:13.692577 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f99cbff2-315b-4d76-bec7-590c5ca9e184 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:13.692978 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f99cbff2-315b-4d76-bec7-590c5ca9e184 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:13.832127 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-f99cbff2-315b-4d76-bec7-590c5ca9e184 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:13.842883 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f99cbff2-315b-4d76-bec7-590c5ca9e184 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.165442 Aug 22 05:42:13.843666 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 269/523] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:13 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:14.870444 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2a8c1de0-1e9d-46a3-b7bf-e19161b28f34 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:14.871048 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2a8c1de0-1e9d-46a3-b7bf-e19161b28f34 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:14.879334 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a8c1de0-1e9d-46a3-b7bf-e19161b28f34 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:14.879848 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a8c1de0-1e9d-46a3-b7bf-e19161b28f34 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:14.880276 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a8c1de0-1e9d-46a3-b7bf-e19161b28f34 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:14.880959 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a8c1de0-1e9d-46a3-b7bf-e19161b28f34 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:14.881404 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a8c1de0-1e9d-46a3-b7bf-e19161b28f34 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:14.881822 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a8c1de0-1e9d-46a3-b7bf-e19161b28f34 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:15.022976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2a8c1de0-1e9d-46a3-b7bf-e19161b28f34 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:15.031461 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2a8c1de0-1e9d-46a3-b7bf-e19161b28f34 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.167253 Aug 22 05:42:15.032039 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 255/524] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:14 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:16.056487 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-81925bf4-a500-4bbb-a47a-94116c095a98 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:16.057159 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-81925bf4-a500-4bbb-a47a-94116c095a98 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:16.064687 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-81925bf4-a500-4bbb-a47a-94116c095a98 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:16.065207 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-81925bf4-a500-4bbb-a47a-94116c095a98 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:16.065680 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-81925bf4-a500-4bbb-a47a-94116c095a98 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:16.066431 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-81925bf4-a500-4bbb-a47a-94116c095a98 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:16.066918 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-81925bf4-a500-4bbb-a47a-94116c095a98 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:16.067376 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-81925bf4-a500-4bbb-a47a-94116c095a98 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:16.201822 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-81925bf4-a500-4bbb-a47a-94116c095a98 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:16.214047 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-81925bf4-a500-4bbb-a47a-94116c095a98 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.163492 Aug 22 05:42:16.214905 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 270/525] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:16 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:17.238463 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e6bac4f4-a82e-43a1-8582-f0789a8458ef tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:17.239398 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e6bac4f4-a82e-43a1-8582-f0789a8458ef tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:17.247486 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6bac4f4-a82e-43a1-8582-f0789a8458ef tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:17.248004 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6bac4f4-a82e-43a1-8582-f0789a8458ef tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:17.248434 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6bac4f4-a82e-43a1-8582-f0789a8458ef tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:17.249140 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6bac4f4-a82e-43a1-8582-f0789a8458ef tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:17.249588 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6bac4f4-a82e-43a1-8582-f0789a8458ef tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:17.250007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6bac4f4-a82e-43a1-8582-f0789a8458ef tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:17.406164 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e6bac4f4-a82e-43a1-8582-f0789a8458ef tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:17.408453 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:17.416836 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e6bac4f4-a82e-43a1-8582-f0789a8458ef tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.184963 Aug 22 05:42:17.417475 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 256/526] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:17 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:17.454158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e3de97a5-514b-43cc-bad5-afdab055d08c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b54e9e5-ad41-4fbc-b291-0e76b1c8e2e2"}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:42:17.456593 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e3de97a5-514b-43cc-bad5-afdab055d08c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:17.463393 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e3de97a5-514b-43cc-bad5-afdab055d08c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:17.463889 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e3de97a5-514b-43cc-bad5-afdab055d08c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:17.464384 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e3de97a5-514b-43cc-bad5-afdab055d08c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:17.465301 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e3de97a5-514b-43cc-bad5-afdab055d08c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:17.465900 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e3de97a5-514b-43cc-bad5-afdab055d08c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:17.465900 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e3de97a5-514b-43cc-bad5-afdab055d08c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:17.740897 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e3de97a5-514b-43cc-bad5-afdab055d08c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "POST /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290366 Aug 22 05:42:17.741619 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 271/527] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 22 05:42:17 2022] POST /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:42:18.438031 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ae0364b5-1a95-4fe2-9f1a-6ae57865910b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:18.438676 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ae0364b5-1a95-4fe2-9f1a-6ae57865910b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:18.445153 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae0364b5-1a95-4fe2-9f1a-6ae57865910b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:18.445629 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae0364b5-1a95-4fe2-9f1a-6ae57865910b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:18.446056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae0364b5-1a95-4fe2-9f1a-6ae57865910b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:18.446774 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae0364b5-1a95-4fe2-9f1a-6ae57865910b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:18.447212 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae0364b5-1a95-4fe2-9f1a-6ae57865910b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:18.447620 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae0364b5-1a95-4fe2-9f1a-6ae57865910b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:18.583672 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ae0364b5-1a95-4fe2-9f1a-6ae57865910b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:18.592384 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ae0364b5-1a95-4fe2-9f1a-6ae57865910b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.158255 Aug 22 05:42:18.592957 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 257/528] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:18 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:19.617699 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-28e6821a-fba7-4093-9100-78dd134b2ff8 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:19.618734 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-28e6821a-fba7-4093-9100-78dd134b2ff8 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:19.625887 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-28e6821a-fba7-4093-9100-78dd134b2ff8 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:19.626374 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-28e6821a-fba7-4093-9100-78dd134b2ff8 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:19.626806 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-28e6821a-fba7-4093-9100-78dd134b2ff8 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:19.627495 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-28e6821a-fba7-4093-9100-78dd134b2ff8 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:19.627977 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-28e6821a-fba7-4093-9100-78dd134b2ff8 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:19.628396 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-28e6821a-fba7-4093-9100-78dd134b2ff8 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:19.777661 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-28e6821a-fba7-4093-9100-78dd134b2ff8 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:19.786022 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-28e6821a-fba7-4093-9100-78dd134b2ff8 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.175916 Aug 22 05:42:19.786579 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 272/529] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:19 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:20.807757 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3ddd7dc1-c0d2-4e4a-81d8-23f62a38dbb5 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:20.808361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3ddd7dc1-c0d2-4e4a-81d8-23f62a38dbb5 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:20.814540 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ddd7dc1-c0d2-4e4a-81d8-23f62a38dbb5 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:20.815019 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ddd7dc1-c0d2-4e4a-81d8-23f62a38dbb5 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:20.815445 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ddd7dc1-c0d2-4e4a-81d8-23f62a38dbb5 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:20.816236 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ddd7dc1-c0d2-4e4a-81d8-23f62a38dbb5 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:20.816610 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ddd7dc1-c0d2-4e4a-81d8-23f62a38dbb5 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:20.817016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ddd7dc1-c0d2-4e4a-81d8-23f62a38dbb5 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:20.954569 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3ddd7dc1-c0d2-4e4a-81d8-23f62a38dbb5 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:20.962745 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3ddd7dc1-c0d2-4e4a-81d8-23f62a38dbb5 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.159065 Aug 22 05:42:20.963737 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 258/530] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:20 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:21.985751 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e3ab00a9-a72c-4377-aacf-831b018bbff0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:21.986361 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e3ab00a9-a72c-4377-aacf-831b018bbff0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:21.993093 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e3ab00a9-a72c-4377-aacf-831b018bbff0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:21.993890 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e3ab00a9-a72c-4377-aacf-831b018bbff0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:21.994697 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e3ab00a9-a72c-4377-aacf-831b018bbff0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:21.995697 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e3ab00a9-a72c-4377-aacf-831b018bbff0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:21.996148 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e3ab00a9-a72c-4377-aacf-831b018bbff0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:21.996566 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e3ab00a9-a72c-4377-aacf-831b018bbff0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:22.134820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e3ab00a9-a72c-4377-aacf-831b018bbff0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:22.143182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e3ab00a9-a72c-4377-aacf-831b018bbff0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.161422 Aug 22 05:42:22.143797 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 273/531] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:21 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:23.165491 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5d604ff2-c5cc-46f2-9f94-eb2420555773 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:23.166088 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5d604ff2-c5cc-46f2-9f94-eb2420555773 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:23.168030 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=40 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:23.174853 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d604ff2-c5cc-46f2-9f94-eb2420555773 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:23.175332 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d604ff2-c5cc-46f2-9f94-eb2420555773 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:23.175809 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d604ff2-c5cc-46f2-9f94-eb2420555773 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:23.176479 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d604ff2-c5cc-46f2-9f94-eb2420555773 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:23.176917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d604ff2-c5cc-46f2-9f94-eb2420555773 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:23.177330 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d604ff2-c5cc-46f2-9f94-eb2420555773 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:23.329507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5d604ff2-c5cc-46f2-9f94-eb2420555773 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:23.341854 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5d604ff2-c5cc-46f2-9f94-eb2420555773 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.180370 Aug 22 05:42:23.342605 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 259/532] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:23 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:24.366672 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-294bc017-b001-4f9c-bc0d-187dc684b3a9 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:24.367248 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-294bc017-b001-4f9c-bc0d-187dc684b3a9 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:24.374705 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-294bc017-b001-4f9c-bc0d-187dc684b3a9 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:24.375145 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-294bc017-b001-4f9c-bc0d-187dc684b3a9 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:24.375635 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-294bc017-b001-4f9c-bc0d-187dc684b3a9 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:24.376459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-294bc017-b001-4f9c-bc0d-187dc684b3a9 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:24.376968 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-294bc017-b001-4f9c-bc0d-187dc684b3a9 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:24.377382 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-294bc017-b001-4f9c-bc0d-187dc684b3a9 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:24.437469 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-facf546b-c217-43e8-aaf9-3d3c42572707 req-30c9c2fb-061a-4aa1-ad89-5f9c843a082a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57433a27-1ab9-4b19-b87b-fc2c80644b94", "name": "network-vif-plugged", "status": "completed", "tag": "d68e991c-9283-490b-b88a-5d68f84a5bd6"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:42:24.447913 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-facf546b-c217-43e8-aaf9-3d3c42572707 req-30c9c2fb-061a-4aa1-ad89-5f9c843a082a service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:24.448464 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-facf546b-c217-43e8-aaf9-3d3c42572707 req-30c9c2fb-061a-4aa1-ad89-5f9c843a082a service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:24.448851 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-facf546b-c217-43e8-aaf9-3d3c42572707 req-30c9c2fb-061a-4aa1-ad89-5f9c843a082a service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:24.466105 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-facf546b-c217-43e8-aaf9-3d3c42572707 req-30c9c2fb-061a-4aa1-ad89-5f9c843a082a service nova] Creating event network-vif-plugged:d68e991c-9283-490b-b88a-5d68f84a5bd6 for instance 57433a27-1ab9-4b19-b87b-fc2c80644b94 on hv-cinder-85391 Aug 22 05:42:24.471933 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-facf546b-c217-43e8-aaf9-3d3c42572707 req-30c9c2fb-061a-4aa1-ad89-5f9c843a082a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038167 Aug 22 05:42:24.472676 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 260/533] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:42:24.524761 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-294bc017-b001-4f9c-bc0d-187dc684b3a9 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:24.533012 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-294bc017-b001-4f9c-bc0d-187dc684b3a9 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.173035 Aug 22 05:42:24.533592 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 274/534] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:24 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:25.554552 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-78dd94ad-e99a-4f57-995c-f88a78a97753 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:25.555248 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-78dd94ad-e99a-4f57-995c-f88a78a97753 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:25.562088 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-78dd94ad-e99a-4f57-995c-f88a78a97753 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:25.562570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-78dd94ad-e99a-4f57-995c-f88a78a97753 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:25.562999 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-78dd94ad-e99a-4f57-995c-f88a78a97753 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:25.563716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-78dd94ad-e99a-4f57-995c-f88a78a97753 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:25.564167 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-78dd94ad-e99a-4f57-995c-f88a78a97753 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:25.564582 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-78dd94ad-e99a-4f57-995c-f88a78a97753 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:25.708175 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-78dd94ad-e99a-4f57-995c-f88a78a97753 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:25.721557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-78dd94ad-e99a-4f57-995c-f88a78a97753 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.171057 Aug 22 05:42:25.722186 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 261/535] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:25 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:26.742330 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-267ea2bd-39f6-4d5f-8bfb-0abc2fe6c2bc tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:26.742948 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-267ea2bd-39f6-4d5f-8bfb-0abc2fe6c2bc tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:26.750540 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-267ea2bd-39f6-4d5f-8bfb-0abc2fe6c2bc tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:26.751024 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-267ea2bd-39f6-4d5f-8bfb-0abc2fe6c2bc tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:26.751460 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-267ea2bd-39f6-4d5f-8bfb-0abc2fe6c2bc tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:26.752336 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-267ea2bd-39f6-4d5f-8bfb-0abc2fe6c2bc tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:26.752786 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-267ea2bd-39f6-4d5f-8bfb-0abc2fe6c2bc tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:26.753208 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-267ea2bd-39f6-4d5f-8bfb-0abc2fe6c2bc tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:26.935320 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-267ea2bd-39f6-4d5f-8bfb-0abc2fe6c2bc tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:26.944217 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-267ea2bd-39f6-4d5f-8bfb-0abc2fe6c2bc tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1260 microversion: 2.1 time: 0.205733 Aug 22 05:42:26.944791 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 275/536] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:26 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:27.966918 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c750e851-7d52-4b30-8517-b329f7051852 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:27.967525 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c750e851-7d52-4b30-8517-b329f7051852 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:27.973563 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c750e851-7d52-4b30-8517-b329f7051852 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:27.974037 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c750e851-7d52-4b30-8517-b329f7051852 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:27.974469 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c750e851-7d52-4b30-8517-b329f7051852 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:27.975156 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c750e851-7d52-4b30-8517-b329f7051852 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:27.975611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c750e851-7d52-4b30-8517-b329f7051852 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:27.976033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c750e851-7d52-4b30-8517-b329f7051852 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:28.107364 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c750e851-7d52-4b30-8517-b329f7051852 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:28.115444 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c750e851-7d52-4b30-8517-b329f7051852 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1445 microversion: 2.1 time: 0.153199 Aug 22 05:42:28.116050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 262/537] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:27 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:28.138177 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4c96a88a-e56a-4ff8-a85c-f7aa0430831d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:28.138947 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4c96a88a-e56a-4ff8-a85c-f7aa0430831d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:28.145816 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c96a88a-e56a-4ff8-a85c-f7aa0430831d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:28.146295 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c96a88a-e56a-4ff8-a85c-f7aa0430831d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:28.146728 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c96a88a-e56a-4ff8-a85c-f7aa0430831d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:28.147651 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c96a88a-e56a-4ff8-a85c-f7aa0430831d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:28.148097 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c96a88a-e56a-4ff8-a85c-f7aa0430831d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:28.148518 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c96a88a-e56a-4ff8-a85c-f7aa0430831d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:28.289792 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4c96a88a-e56a-4ff8-a85c-f7aa0430831d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:28.297834 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4c96a88a-e56a-4ff8-a85c-f7aa0430831d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1445 microversion: 2.1 time: 0.164361 Aug 22 05:42:28.298414 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 276/538] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:28 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1445 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:30.403164 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-7dadacd7-3697-4450-9fd9-4d24e4f4487d req-f267c448-b287-4641-8caa-a8cd2df69cfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57433a27-1ab9-4b19-b87b-fc2c80644b94", "tag": "d68e991c-9283-490b-b88a-5d68f84a5bd6"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:42:30.412488 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7dadacd7-3697-4450-9fd9-4d24e4f4487d req-f267c448-b287-4641-8caa-a8cd2df69cfb service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:30.412952 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7dadacd7-3697-4450-9fd9-4d24e4f4487d req-f267c448-b287-4641-8caa-a8cd2df69cfb service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:30.413370 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7dadacd7-3697-4450-9fd9-4d24e4f4487d req-f267c448-b287-4641-8caa-a8cd2df69cfb service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:30.424814 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-7dadacd7-3697-4450-9fd9-4d24e4f4487d req-f267c448-b287-4641-8caa-a8cd2df69cfb service nova] Creating event network-changed:d68e991c-9283-490b-b88a-5d68f84a5bd6 for instance 57433a27-1ab9-4b19-b87b-fc2c80644b94 on hv-cinder-85391 Aug 22 05:42:30.430036 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-7dadacd7-3697-4450-9fd9-4d24e4f4487d req-f267c448-b287-4641-8caa-a8cd2df69cfb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031071 Aug 22 05:42:30.431041 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 263/539] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:42:32.763214 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c9e5fd66-2617-4331-aa8a-d4393ff1975e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:42:32.770401 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c9e5fd66-2617-4331-aa8a-d4393ff1975e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:32.770885 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c9e5fd66-2617-4331-aa8a-d4393ff1975e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:32.771310 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c9e5fd66-2617-4331-aa8a-d4393ff1975e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:32.831642 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c9e5fd66-2617-4331-aa8a-d4393ff1975e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Going to try to stop instance {{(pid=132497) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 22 05:42:32.877154 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c9e5fd66-2617-4331-aa8a-d4393ff1975e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "POST /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/action" status: 202 len: 0 microversion: 2.1 time: 0.117781 Aug 22 05:42:32.877817 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 277/540] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 22 05:42:32 2022] POST /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:42:32.886754 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-22724398-4363-467b-92cd-f01b2833d02e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:32.887438 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-22724398-4363-467b-92cd-f01b2833d02e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:32.893638 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22724398-4363-467b-92cd-f01b2833d02e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:32.894096 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22724398-4363-467b-92cd-f01b2833d02e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:32.894709 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22724398-4363-467b-92cd-f01b2833d02e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:32.895555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22724398-4363-467b-92cd-f01b2833d02e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:32.896020 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22724398-4363-467b-92cd-f01b2833d02e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:32.896620 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-22724398-4363-467b-92cd-f01b2833d02e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:33.047197 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-22724398-4363-467b-92cd-f01b2833d02e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:33.055690 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-22724398-4363-467b-92cd-f01b2833d02e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1722 microversion: 2.1 time: 0.173209 Aug 22 05:42:33.056230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 264/541] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:32 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:42:34.081208 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e40a0cd2-2dca-45b7-9be0-0d62fef1f20c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:34.082047 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e40a0cd2-2dca-45b7-9be0-0d62fef1f20c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:34.091878 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e40a0cd2-2dca-45b7-9be0-0d62fef1f20c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:34.092386 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e40a0cd2-2dca-45b7-9be0-0d62fef1f20c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:34.092830 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e40a0cd2-2dca-45b7-9be0-0d62fef1f20c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:34.093508 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e40a0cd2-2dca-45b7-9be0-0d62fef1f20c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:34.093945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e40a0cd2-2dca-45b7-9be0-0d62fef1f20c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:34.094355 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e40a0cd2-2dca-45b7-9be0-0d62fef1f20c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:34.242756 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e40a0cd2-2dca-45b7-9be0-0d62fef1f20c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:34.251317 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e40a0cd2-2dca-45b7-9be0-0d62fef1f20c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1722 microversion: 2.1 time: 0.176798 Aug 22 05:42:34.251916 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 278/542] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:34 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:35.277399 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d42cc5f5-81ad-462a-8bbc-a79324d843dd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:35.278436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d42cc5f5-81ad-462a-8bbc-a79324d843dd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:35.289257 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d42cc5f5-81ad-462a-8bbc-a79324d843dd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:35.290114 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d42cc5f5-81ad-462a-8bbc-a79324d843dd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:35.290951 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d42cc5f5-81ad-462a-8bbc-a79324d843dd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:35.292351 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d42cc5f5-81ad-462a-8bbc-a79324d843dd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:35.293109 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d42cc5f5-81ad-462a-8bbc-a79324d843dd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:35.293802 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d42cc5f5-81ad-462a-8bbc-a79324d843dd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:35.447920 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d42cc5f5-81ad-462a-8bbc-a79324d843dd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:35.456992 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d42cc5f5-81ad-462a-8bbc-a79324d843dd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1722 microversion: 2.1 time: 0.186183 Aug 22 05:42:35.457560 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 265/543] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:35 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:36.480718 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4d23ec02-a888-41c9-bd5b-b70259a2ae0e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:36.481314 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4d23ec02-a888-41c9-bd5b-b70259a2ae0e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:36.488508 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4d23ec02-a888-41c9-bd5b-b70259a2ae0e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:36.489007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4d23ec02-a888-41c9-bd5b-b70259a2ae0e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:36.489437 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4d23ec02-a888-41c9-bd5b-b70259a2ae0e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:36.490132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4d23ec02-a888-41c9-bd5b-b70259a2ae0e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:36.490555 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4d23ec02-a888-41c9-bd5b-b70259a2ae0e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:36.491044 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4d23ec02-a888-41c9-bd5b-b70259a2ae0e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:36.620092 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4d23ec02-a888-41c9-bd5b-b70259a2ae0e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:36.632141 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4d23ec02-a888-41c9-bd5b-b70259a2ae0e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1722 microversion: 2.1 time: 0.156695 Aug 22 05:42:36.633080 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 279/544] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:36 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:37.657503 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b943e669-cea8-4d70-b870-25a29d2a6fbc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:37.658105 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b943e669-cea8-4d70-b870-25a29d2a6fbc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:37.664343 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b943e669-cea8-4d70-b870-25a29d2a6fbc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:37.664820 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b943e669-cea8-4d70-b870-25a29d2a6fbc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:37.665708 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b943e669-cea8-4d70-b870-25a29d2a6fbc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:37.665913 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b943e669-cea8-4d70-b870-25a29d2a6fbc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:37.666355 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b943e669-cea8-4d70-b870-25a29d2a6fbc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:37.666772 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b943e669-cea8-4d70-b870-25a29d2a6fbc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:37.829572 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b943e669-cea8-4d70-b870-25a29d2a6fbc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:37.838800 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b943e669-cea8-4d70-b870-25a29d2a6fbc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1722 microversion: 2.1 time: 0.185491 Aug 22 05:42:37.839887 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 266/545] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:37 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:38.861737 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-dc3e24bb-9e09-42a1-80f7-4380e8670506 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:38.862353 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-dc3e24bb-9e09-42a1-80f7-4380e8670506 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:38.869272 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc3e24bb-9e09-42a1-80f7-4380e8670506 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:38.869790 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc3e24bb-9e09-42a1-80f7-4380e8670506 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:38.870223 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc3e24bb-9e09-42a1-80f7-4380e8670506 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:38.870915 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc3e24bb-9e09-42a1-80f7-4380e8670506 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:38.871365 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc3e24bb-9e09-42a1-80f7-4380e8670506 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:38.871829 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc3e24bb-9e09-42a1-80f7-4380e8670506 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:38.874497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:39.004796 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-dc3e24bb-9e09-42a1-80f7-4380e8670506 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:39.017215 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-dc3e24bb-9e09-42a1-80f7-4380e8670506 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1722 microversion: 2.1 time: 0.159628 Aug 22 05:42:39.017775 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 280/546] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:38 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:40.042754 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0f7b3667-6752-41b5-86bb-aaacb815d60e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:40.043691 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0f7b3667-6752-41b5-86bb-aaacb815d60e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:40.053656 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f7b3667-6752-41b5-86bb-aaacb815d60e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:40.054453 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f7b3667-6752-41b5-86bb-aaacb815d60e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:40.055169 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f7b3667-6752-41b5-86bb-aaacb815d60e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:40.056238 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f7b3667-6752-41b5-86bb-aaacb815d60e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:40.056987 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f7b3667-6752-41b5-86bb-aaacb815d60e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:40.057687 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f7b3667-6752-41b5-86bb-aaacb815d60e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:40.204248 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0f7b3667-6752-41b5-86bb-aaacb815d60e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:40.217180 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0f7b3667-6752-41b5-86bb-aaacb815d60e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1722 microversion: 2.1 time: 0.180626 Aug 22 05:42:40.218007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 267/547] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:40 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:41.242386 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-bf87d8ac-843f-4a51-b917-d8f0834f1b75 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:41.243145 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-bf87d8ac-843f-4a51-b917-d8f0834f1b75 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:41.251817 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bf87d8ac-843f-4a51-b917-d8f0834f1b75 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:41.252447 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bf87d8ac-843f-4a51-b917-d8f0834f1b75 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:41.253009 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bf87d8ac-843f-4a51-b917-d8f0834f1b75 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:41.253912 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bf87d8ac-843f-4a51-b917-d8f0834f1b75 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:41.254501 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bf87d8ac-843f-4a51-b917-d8f0834f1b75 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:41.255053 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bf87d8ac-843f-4a51-b917-d8f0834f1b75 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:41.402232 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-bf87d8ac-843f-4a51-b917-d8f0834f1b75 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:41.412974 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-bf87d8ac-843f-4a51-b917-d8f0834f1b75 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1722 microversion: 2.1 time: 0.176265 Aug 22 05:42:41.413351 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 281/548] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:41 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:42.434282 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-db721bd9-f1c2-4dc9-8437-2b64ffc75948 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:42.434884 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-db721bd9-f1c2-4dc9-8437-2b64ffc75948 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:42.441525 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-db721bd9-f1c2-4dc9-8437-2b64ffc75948 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:42.442049 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-db721bd9-f1c2-4dc9-8437-2b64ffc75948 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:42.442507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-db721bd9-f1c2-4dc9-8437-2b64ffc75948 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:42.443192 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-db721bd9-f1c2-4dc9-8437-2b64ffc75948 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:42.443673 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-db721bd9-f1c2-4dc9-8437-2b64ffc75948 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:42.444094 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-db721bd9-f1c2-4dc9-8437-2b64ffc75948 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:42.572911 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-db721bd9-f1c2-4dc9-8437-2b64ffc75948 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:42.581468 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-db721bd9-f1c2-4dc9-8437-2b64ffc75948 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1722 microversion: 2.1 time: 0.151115 Aug 22 05:42:42.582063 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 268/549] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:42 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:43.604872 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-988d4bbe-76ba-42e8-8e68-746364018891 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:43.605447 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-988d4bbe-76ba-42e8-8e68-746364018891 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:43.607831 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=28 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:43.613200 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-988d4bbe-76ba-42e8-8e68-746364018891 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:43.613730 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-988d4bbe-76ba-42e8-8e68-746364018891 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:43.614159 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-988d4bbe-76ba-42e8-8e68-746364018891 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:43.614837 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-988d4bbe-76ba-42e8-8e68-746364018891 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:43.615303 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-988d4bbe-76ba-42e8-8e68-746364018891 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:43.615850 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-988d4bbe-76ba-42e8-8e68-746364018891 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:43.753221 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-988d4bbe-76ba-42e8-8e68-746364018891 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:43.761714 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-988d4bbe-76ba-42e8-8e68-746364018891 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1699 microversion: 2.1 time: 0.160774 Aug 22 05:42:43.762279 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 282/550] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:43 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1699 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:43.786234 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d4334e5f-2d0d-4e94-8307-7929edf9ddff tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:42:43.793687 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4334e5f-2d0d-4e94-8307-7929edf9ddff tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:43.794163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4334e5f-2d0d-4e94-8307-7929edf9ddff tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:43.794587 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4334e5f-2d0d-4e94-8307-7929edf9ddff tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:43.854337 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d4334e5f-2d0d-4e94-8307-7929edf9ddff tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Going to try to start instance {{(pid=132498) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 22 05:42:43.901726 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d4334e5f-2d0d-4e94-8307-7929edf9ddff tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "POST /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/action" status: 202 len: 0 microversion: 2.1 time: 0.121870 Aug 22 05:42:43.902958 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 269/551] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 22 05:42:43 2022] POST /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:42:43.913429 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ae3e10cf-882a-49d8-bd61-4597425b7450 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:43.914043 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ae3e10cf-882a-49d8-bd61-4597425b7450 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:43.920504 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ae3e10cf-882a-49d8-bd61-4597425b7450 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:43.921001 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ae3e10cf-882a-49d8-bd61-4597425b7450 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:43.921477 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ae3e10cf-882a-49d8-bd61-4597425b7450 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:43.922243 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ae3e10cf-882a-49d8-bd61-4597425b7450 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:43.922700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ae3e10cf-882a-49d8-bd61-4597425b7450 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:43.923122 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ae3e10cf-882a-49d8-bd61-4597425b7450 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:44.101435 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ae3e10cf-882a-49d8-bd61-4597425b7450 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:44.110194 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ae3e10cf-882a-49d8-bd61-4597425b7450 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1708 microversion: 2.1 time: 0.202461 Aug 22 05:42:44.110777 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 283/552] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:43 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1708 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:45.135109 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d6469b8b-5042-4cc7-9072-be282e87f2a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:45.135942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d6469b8b-5042-4cc7-9072-be282e87f2a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:45.143975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6469b8b-5042-4cc7-9072-be282e87f2a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:45.144535 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6469b8b-5042-4cc7-9072-be282e87f2a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:45.145035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6469b8b-5042-4cc7-9072-be282e87f2a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:45.145825 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6469b8b-5042-4cc7-9072-be282e87f2a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:45.146467 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6469b8b-5042-4cc7-9072-be282e87f2a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:45.147228 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6469b8b-5042-4cc7-9072-be282e87f2a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:45.289482 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d6469b8b-5042-4cc7-9072-be282e87f2a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:45.297768 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d6469b8b-5042-4cc7-9072-be282e87f2a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1708 microversion: 2.1 time: 0.168345 Aug 22 05:42:45.298351 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 270/553] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:45 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1708 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:42:46.330887 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-49ac27a3-c92a-4512-ac6f-cf51e2549a18 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:42:46.331815 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-49ac27a3-c92a-4512-ac6f-cf51e2549a18 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:42:46.339598 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-49ac27a3-c92a-4512-ac6f-cf51e2549a18 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:46.340096 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-49ac27a3-c92a-4512-ac6f-cf51e2549a18 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:46.340525 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-49ac27a3-c92a-4512-ac6f-cf51e2549a18 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:46.341672 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-49ac27a3-c92a-4512-ac6f-cf51e2549a18 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:42:46.342134 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-49ac27a3-c92a-4512-ac6f-cf51e2549a18 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:42:46.342537 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-49ac27a3-c92a-4512-ac6f-cf51e2549a18 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:42:46.478967 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-49ac27a3-c92a-4512-ac6f-cf51e2549a18 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:42:46.487472 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-49ac27a3-c92a-4512-ac6f-cf51e2549a18 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1712 microversion: 2.1 time: 0.163129 Aug 22 05:42:46.488073 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 284/554] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:42:46 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1712 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:43:10.353328 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c6cfd8cf-f030-4703-b223-459a1e3fed3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:10.354003 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c6cfd8cf-f030-4703-b223-459a1e3fed3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:10.356513 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=23 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:10.357393 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:10.364473 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6cfd8cf-f030-4703-b223-459a1e3fed3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:10.364943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6cfd8cf-f030-4703-b223-459a1e3fed3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:10.365357 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6cfd8cf-f030-4703-b223-459a1e3fed3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:10.366034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6cfd8cf-f030-4703-b223-459a1e3fed3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:10.366564 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6cfd8cf-f030-4703-b223-459a1e3fed3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:10.367050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6cfd8cf-f030-4703-b223-459a1e3fed3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:10.392056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c6cfd8cf-f030-4703-b223-459a1e3fed3f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/ips" status: 200 len: 151 microversion: 2.20 time: 0.043779 Aug 22 05:43:10.392964 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 271/555] 10.222.0.18 () {60 vars in 1289 bytes} [Mon Aug 22 05:43:10 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:43:12.389657 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-d9832ce9-a188-4272-bf87-e89c7e6f63cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:43:12.390348 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-d9832ce9-a188-4272-bf87-e89c7e6f63cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:12.392253 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=5 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:12.392900 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=29 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:12.400641 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d9832ce9-a188-4272-bf87-e89c7e6f63cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:12.401302 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d9832ce9-a188-4272-bf87-e89c7e6f63cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:12.401950 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d9832ce9-a188-4272-bf87-e89c7e6f63cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:12.402912 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d9832ce9-a188-4272-bf87-e89c7e6f63cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:12.403337 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d9832ce9-a188-4272-bf87-e89c7e6f63cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:12.403796 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d9832ce9-a188-4272-bf87-e89c7e6f63cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:12.433024 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.objects.instance [None req-d9832ce9-a188-4272-bf87-e89c7e6f63cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lazy-loading 'flavor' on Instance uuid 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb {{(pid=132497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:43:12.879068 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-d9832ce9-a188-4272-bf87-e89c7e6f63cd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "POST /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/action" status: 202 len: 0 microversion: 2.20 time: 0.493447 Aug 22 05:43:12.879691 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 285/556] 10.222.0.18 () {62 vars in 1319 bytes} [Mon Aug 22 05:43:12 2022] POST /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:43:12.889026 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2ee93ce7-cbb9-46a8-831f-f58ffcb192e6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:12.889997 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2ee93ce7-cbb9-46a8-831f-f58ffcb192e6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:12.896729 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ee93ce7-cbb9-46a8-831f-f58ffcb192e6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:12.897595 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ee93ce7-cbb9-46a8-831f-f58ffcb192e6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:12.898446 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ee93ce7-cbb9-46a8-831f-f58ffcb192e6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:12.899746 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ee93ce7-cbb9-46a8-831f-f58ffcb192e6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:12.900577 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ee93ce7-cbb9-46a8-831f-f58ffcb192e6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:12.901318 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ee93ce7-cbb9-46a8-831f-f58ffcb192e6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:13.138491 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2ee93ce7-cbb9-46a8-831f-f58ffcb192e6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:13.156224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2ee93ce7-cbb9-46a8-831f-f58ffcb192e6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:13.160361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2ee93ce7-cbb9-46a8-831f-f58ffcb192e6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:13.162925 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2ee93ce7-cbb9-46a8-831f-f58ffcb192e6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1722 microversion: 2.20 time: 0.278183 Aug 22 05:43:13.164198 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 272/557] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:12 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:14.191668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c08b995d-c6af-483b-94d0-3d170e7a2930 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:14.192642 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c08b995d-c6af-483b-94d0-3d170e7a2930 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:14.203174 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c08b995d-c6af-483b-94d0-3d170e7a2930 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:14.204001 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c08b995d-c6af-483b-94d0-3d170e7a2930 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:14.204725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c08b995d-c6af-483b-94d0-3d170e7a2930 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:14.205863 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c08b995d-c6af-483b-94d0-3d170e7a2930 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:14.206373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c08b995d-c6af-483b-94d0-3d170e7a2930 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:14.206906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c08b995d-c6af-483b-94d0-3d170e7a2930 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:14.354757 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c08b995d-c6af-483b-94d0-3d170e7a2930 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:14.363291 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c08b995d-c6af-483b-94d0-3d170e7a2930 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:14.364879 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c08b995d-c6af-483b-94d0-3d170e7a2930 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:14.366036 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c08b995d-c6af-483b-94d0-3d170e7a2930 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1722 microversion: 2.20 time: 0.182400 Aug 22 05:43:14.366576 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 286/558] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:14 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:15.388817 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-59068975-cc2f-4855-b8fb-88c5b8925fc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:15.389437 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-59068975-cc2f-4855-b8fb-88c5b8925fc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:15.395925 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-59068975-cc2f-4855-b8fb-88c5b8925fc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:15.396410 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-59068975-cc2f-4855-b8fb-88c5b8925fc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:15.396865 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-59068975-cc2f-4855-b8fb-88c5b8925fc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:15.397537 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-59068975-cc2f-4855-b8fb-88c5b8925fc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:15.397980 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-59068975-cc2f-4855-b8fb-88c5b8925fc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:15.398488 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-59068975-cc2f-4855-b8fb-88c5b8925fc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:15.533894 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-59068975-cc2f-4855-b8fb-88c5b8925fc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:15.542788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-59068975-cc2f-4855-b8fb-88c5b8925fc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:15.544353 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-59068975-cc2f-4855-b8fb-88c5b8925fc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:15.545508 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-59068975-cc2f-4855-b8fb-88c5b8925fc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1722 microversion: 2.20 time: 0.160640 Aug 22 05:43:15.546044 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 273/559] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:15 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:16.568137 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-d10a0e29-cd13-4e1f-a02c-d9a610a4dc54 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:16.568771 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-d10a0e29-cd13-4e1f-a02c-d9a610a4dc54 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:16.576409 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d10a0e29-cd13-4e1f-a02c-d9a610a4dc54 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:16.576887 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d10a0e29-cd13-4e1f-a02c-d9a610a4dc54 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:16.577313 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d10a0e29-cd13-4e1f-a02c-d9a610a4dc54 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:16.577997 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d10a0e29-cd13-4e1f-a02c-d9a610a4dc54 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:16.578443 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d10a0e29-cd13-4e1f-a02c-d9a610a4dc54 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:16.578861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d10a0e29-cd13-4e1f-a02c-d9a610a4dc54 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:16.717987 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-d10a0e29-cd13-4e1f-a02c-d9a610a4dc54 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:16.726619 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-d10a0e29-cd13-4e1f-a02c-d9a610a4dc54 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:16.728269 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-d10a0e29-cd13-4e1f-a02c-d9a610a4dc54 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:16.729423 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-d10a0e29-cd13-4e1f-a02c-d9a610a4dc54 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1722 microversion: 2.20 time: 0.165318 Aug 22 05:43:16.729984 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 287/560] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:16 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:17.759422 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-061814f3-d09d-40cc-806b-af3423b6d4a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:17.760028 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-061814f3-d09d-40cc-806b-af3423b6d4a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:17.766163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-061814f3-d09d-40cc-806b-af3423b6d4a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:17.766645 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-061814f3-d09d-40cc-806b-af3423b6d4a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:17.767074 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-061814f3-d09d-40cc-806b-af3423b6d4a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:17.767798 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-061814f3-d09d-40cc-806b-af3423b6d4a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:17.768242 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-061814f3-d09d-40cc-806b-af3423b6d4a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:17.768659 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-061814f3-d09d-40cc-806b-af3423b6d4a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:17.900361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-061814f3-d09d-40cc-806b-af3423b6d4a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:17.909099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-061814f3-d09d-40cc-806b-af3423b6d4a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:17.910591 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-061814f3-d09d-40cc-806b-af3423b6d4a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:17.911802 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-061814f3-d09d-40cc-806b-af3423b6d4a3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1722 microversion: 2.20 time: 0.156379 Aug 22 05:43:17.912372 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 274/561] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:17 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:18.934879 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a5dd2c82-1f65-4ca6-9bc7-525369da4852 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:18.935440 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a5dd2c82-1f65-4ca6-9bc7-525369da4852 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:18.942633 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a5dd2c82-1f65-4ca6-9bc7-525369da4852 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:18.943116 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a5dd2c82-1f65-4ca6-9bc7-525369da4852 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:18.943548 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a5dd2c82-1f65-4ca6-9bc7-525369da4852 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:18.944276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a5dd2c82-1f65-4ca6-9bc7-525369da4852 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:18.944726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a5dd2c82-1f65-4ca6-9bc7-525369da4852 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:18.945148 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a5dd2c82-1f65-4ca6-9bc7-525369da4852 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:19.082095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a5dd2c82-1f65-4ca6-9bc7-525369da4852 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:19.090284 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a5dd2c82-1f65-4ca6-9bc7-525369da4852 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:19.092189 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a5dd2c82-1f65-4ca6-9bc7-525369da4852 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:19.093334 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a5dd2c82-1f65-4ca6-9bc7-525369da4852 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1722 microversion: 2.20 time: 0.162468 Aug 22 05:43:19.093915 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 288/562] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:18 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:20.119660 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4d68c9e8-560d-40ce-aa0c-96acc855502d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:20.120269 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4d68c9e8-560d-40ce-aa0c-96acc855502d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:20.126806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d68c9e8-560d-40ce-aa0c-96acc855502d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:20.127279 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d68c9e8-560d-40ce-aa0c-96acc855502d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:20.127741 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d68c9e8-560d-40ce-aa0c-96acc855502d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:20.128415 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d68c9e8-560d-40ce-aa0c-96acc855502d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:20.128854 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d68c9e8-560d-40ce-aa0c-96acc855502d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:20.129260 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d68c9e8-560d-40ce-aa0c-96acc855502d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:20.270717 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4d68c9e8-560d-40ce-aa0c-96acc855502d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:20.279069 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4d68c9e8-560d-40ce-aa0c-96acc855502d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:20.280592 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4d68c9e8-560d-40ce-aa0c-96acc855502d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:20.281734 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4d68c9e8-560d-40ce-aa0c-96acc855502d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1722 microversion: 2.20 time: 0.168224 Aug 22 05:43:20.282293 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 275/563] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:20 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:20.802124 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 05:43:20.802665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Mon Aug 22 05:43:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 05:43:21.305627 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0a6122c0-144e-4d78-90cd-1c4d854ee3f2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:21.306380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0a6122c0-144e-4d78-90cd-1c4d854ee3f2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:21.313356 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a6122c0-144e-4d78-90cd-1c4d854ee3f2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:21.313847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a6122c0-144e-4d78-90cd-1c4d854ee3f2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:21.314280 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a6122c0-144e-4d78-90cd-1c4d854ee3f2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:21.315012 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a6122c0-144e-4d78-90cd-1c4d854ee3f2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:21.315463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a6122c0-144e-4d78-90cd-1c4d854ee3f2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:21.315917 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a6122c0-144e-4d78-90cd-1c4d854ee3f2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:21.706060 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0a6122c0-144e-4d78-90cd-1c4d854ee3f2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:21.716609 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0a6122c0-144e-4d78-90cd-1c4d854ee3f2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:21.718152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0a6122c0-144e-4d78-90cd-1c4d854ee3f2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:21.719322 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0a6122c0-144e-4d78-90cd-1c4d854ee3f2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1722 microversion: 2.20 time: 0.417788 Aug 22 05:43:21.719932 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 289/564] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:21 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1722 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:22.747276 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-27f6ea32-ba1f-4e29-a91c-24ad7e44b211 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:22.748260 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-27f6ea32-ba1f-4e29-a91c-24ad7e44b211 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:22.758967 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27f6ea32-ba1f-4e29-a91c-24ad7e44b211 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:22.760003 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27f6ea32-ba1f-4e29-a91c-24ad7e44b211 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:22.760755 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27f6ea32-ba1f-4e29-a91c-24ad7e44b211 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:22.761233 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27f6ea32-ba1f-4e29-a91c-24ad7e44b211 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:22.761735 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27f6ea32-ba1f-4e29-a91c-24ad7e44b211 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:22.762385 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-27f6ea32-ba1f-4e29-a91c-24ad7e44b211 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:22.907906 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-27f6ea32-ba1f-4e29-a91c-24ad7e44b211 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:22.916719 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-27f6ea32-ba1f-4e29-a91c-24ad7e44b211 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:22.917882 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-27f6ea32-ba1f-4e29-a91c-24ad7e44b211 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:22.919031 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-27f6ea32-ba1f-4e29-a91c-24ad7e44b211 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1722 microversion: 2.20 time: 0.179106 Aug 22 05:43:22.919624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 276/565] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:22 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:23.948728 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c8a7a7d5-a153-4492-9a4c-124a078a9264 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:23.948728 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c8a7a7d5-a153-4492-9a4c-124a078a9264 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:23.954485 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c8a7a7d5-a153-4492-9a4c-124a078a9264 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:23.954969 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c8a7a7d5-a153-4492-9a4c-124a078a9264 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:23.955410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c8a7a7d5-a153-4492-9a4c-124a078a9264 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:23.956142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c8a7a7d5-a153-4492-9a4c-124a078a9264 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:23.956592 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c8a7a7d5-a153-4492-9a4c-124a078a9264 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:23.957015 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c8a7a7d5-a153-4492-9a4c-124a078a9264 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:24.094048 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c8a7a7d5-a153-4492-9a4c-124a078a9264 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:24.105832 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c8a7a7d5-a153-4492-9a4c-124a078a9264 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:24.107329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c8a7a7d5-a153-4492-9a4c-124a078a9264 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:24.108502 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c8a7a7d5-a153-4492-9a4c-124a078a9264 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1722 microversion: 2.20 time: 0.165829 Aug 22 05:43:24.109092 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 290/566] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:23 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:25.145222 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-864598c9-19f2-45c9-b0af-c067ab94916f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:25.146298 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-864598c9-19f2-45c9-b0af-c067ab94916f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:25.154925 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-864598c9-19f2-45c9-b0af-c067ab94916f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:25.155313 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-864598c9-19f2-45c9-b0af-c067ab94916f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:25.155810 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-864598c9-19f2-45c9-b0af-c067ab94916f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:25.156492 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-864598c9-19f2-45c9-b0af-c067ab94916f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:25.156938 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-864598c9-19f2-45c9-b0af-c067ab94916f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:25.157374 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-864598c9-19f2-45c9-b0af-c067ab94916f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:25.300065 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-864598c9-19f2-45c9-b0af-c067ab94916f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:25.309086 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-864598c9-19f2-45c9-b0af-c067ab94916f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:25.310585 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-864598c9-19f2-45c9-b0af-c067ab94916f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:25.311806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-864598c9-19f2-45c9-b0af-c067ab94916f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1722 microversion: 2.20 time: 0.173205 Aug 22 05:43:25.312369 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 277/567] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:25 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:26.339504 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-aa644b7d-cd1c-41bb-bce5-58a99452347c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:26.340495 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-aa644b7d-cd1c-41bb-bce5-58a99452347c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:26.351613 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aa644b7d-cd1c-41bb-bce5-58a99452347c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:26.352453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aa644b7d-cd1c-41bb-bce5-58a99452347c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:26.353119 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aa644b7d-cd1c-41bb-bce5-58a99452347c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:26.354327 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aa644b7d-cd1c-41bb-bce5-58a99452347c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:26.354768 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aa644b7d-cd1c-41bb-bce5-58a99452347c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:26.355256 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aa644b7d-cd1c-41bb-bce5-58a99452347c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:26.489365 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-aa644b7d-cd1c-41bb-bce5-58a99452347c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:26.502746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-aa644b7d-cd1c-41bb-bce5-58a99452347c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:26.504840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-aa644b7d-cd1c-41bb-bce5-58a99452347c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:26.506542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-aa644b7d-cd1c-41bb-bce5-58a99452347c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1722 microversion: 2.20 time: 0.173403 Aug 22 05:43:26.507246 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 291/568] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:26 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:27.531743 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-46855045-cd72-4431-991b-d1a0a8069c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:27.532341 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-46855045-cd72-4431-991b-d1a0a8069c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:27.538714 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-46855045-cd72-4431-991b-d1a0a8069c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:27.539184 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-46855045-cd72-4431-991b-d1a0a8069c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:27.539607 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-46855045-cd72-4431-991b-d1a0a8069c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:27.540309 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-46855045-cd72-4431-991b-d1a0a8069c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:27.540748 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-46855045-cd72-4431-991b-d1a0a8069c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:27.541157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-46855045-cd72-4431-991b-d1a0a8069c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:27.675453 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-46855045-cd72-4431-991b-d1a0a8069c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:27.684089 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-46855045-cd72-4431-991b-d1a0a8069c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:27.685561 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-46855045-cd72-4431-991b-d1a0a8069c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:27.686689 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-46855045-cd72-4431-991b-d1a0a8069c6e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1722 microversion: 2.20 time: 0.158979 Aug 22 05:43:27.687283 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 278/569] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:27 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:28.716468 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-3e768776-e67d-42c7-ba45-d047a005a055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:28.717377 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-3e768776-e67d-42c7-ba45-d047a005a055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:28.728818 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3e768776-e67d-42c7-ba45-d047a005a055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:28.729871 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3e768776-e67d-42c7-ba45-d047a005a055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:28.730762 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3e768776-e67d-42c7-ba45-d047a005a055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:28.731465 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3e768776-e67d-42c7-ba45-d047a005a055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:28.731931 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3e768776-e67d-42c7-ba45-d047a005a055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:28.732345 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3e768776-e67d-42c7-ba45-d047a005a055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:28.871535 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-3e768776-e67d-42c7-ba45-d047a005a055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:28.880255 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-3e768776-e67d-42c7-ba45-d047a005a055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:28.881771 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-3e768776-e67d-42c7-ba45-d047a005a055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:28.882908 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-3e768776-e67d-42c7-ba45-d047a005a055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1722 microversion: 2.20 time: 0.175505 Aug 22 05:43:28.883463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 292/570] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:28 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:29.906926 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2ef65361-a9f4-4412-9355-f18defd0c3a0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:29.907518 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2ef65361-a9f4-4412-9355-f18defd0c3a0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:29.913858 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ef65361-a9f4-4412-9355-f18defd0c3a0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:29.914331 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ef65361-a9f4-4412-9355-f18defd0c3a0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:29.914737 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ef65361-a9f4-4412-9355-f18defd0c3a0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:29.915426 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ef65361-a9f4-4412-9355-f18defd0c3a0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:29.915901 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ef65361-a9f4-4412-9355-f18defd0c3a0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:29.916313 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ef65361-a9f4-4412-9355-f18defd0c3a0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:30.051526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2ef65361-a9f4-4412-9355-f18defd0c3a0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:30.064168 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2ef65361-a9f4-4412-9355-f18defd0c3a0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:30.066459 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2ef65361-a9f4-4412-9355-f18defd0c3a0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:30.068187 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2ef65361-a9f4-4412-9355-f18defd0c3a0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1743 microversion: 2.20 time: 0.165251 Aug 22 05:43:30.068993 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 279/571] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:29 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:31.097182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-19a60169-0c83-405f-b8cc-a8272bed0024 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:31.098290 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-19a60169-0c83-405f-b8cc-a8272bed0024 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:31.107618 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19a60169-0c83-405f-b8cc-a8272bed0024 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:31.108136 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19a60169-0c83-405f-b8cc-a8272bed0024 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:31.108555 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19a60169-0c83-405f-b8cc-a8272bed0024 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:31.109238 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19a60169-0c83-405f-b8cc-a8272bed0024 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:31.109677 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19a60169-0c83-405f-b8cc-a8272bed0024 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:31.110089 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19a60169-0c83-405f-b8cc-a8272bed0024 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:31.248172 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-19a60169-0c83-405f-b8cc-a8272bed0024 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:31.256531 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-19a60169-0c83-405f-b8cc-a8272bed0024 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:31.258056 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-19a60169-0c83-405f-b8cc-a8272bed0024 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:31.259216 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-19a60169-0c83-405f-b8cc-a8272bed0024 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1743 microversion: 2.20 time: 0.169221 Aug 22 05:43:31.259802 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 293/572] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:31 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:32.286679 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8f1ad983-94b9-43e4-ab67-7f4d31ccdde9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:32.287636 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8f1ad983-94b9-43e4-ab67-7f4d31ccdde9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:32.295762 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f1ad983-94b9-43e4-ab67-7f4d31ccdde9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:32.296235 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f1ad983-94b9-43e4-ab67-7f4d31ccdde9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:32.296657 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f1ad983-94b9-43e4-ab67-7f4d31ccdde9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:32.297337 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f1ad983-94b9-43e4-ab67-7f4d31ccdde9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:32.297775 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f1ad983-94b9-43e4-ab67-7f4d31ccdde9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:32.298181 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f1ad983-94b9-43e4-ab67-7f4d31ccdde9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:32.447638 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8f1ad983-94b9-43e4-ab67-7f4d31ccdde9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:32.456678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8f1ad983-94b9-43e4-ab67-7f4d31ccdde9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:32.458160 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8f1ad983-94b9-43e4-ab67-7f4d31ccdde9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:32.459301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8f1ad983-94b9-43e4-ab67-7f4d31ccdde9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1743 microversion: 2.20 time: 0.179342 Aug 22 05:43:32.459895 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 280/573] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:32 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:33.486865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b279a921-703c-486b-bfb4-08995c83a818 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:33.487492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b279a921-703c-486b-bfb4-08995c83a818 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:33.496781 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b279a921-703c-486b-bfb4-08995c83a818 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:33.497252 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b279a921-703c-486b-bfb4-08995c83a818 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:33.497674 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b279a921-703c-486b-bfb4-08995c83a818 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:33.498374 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b279a921-703c-486b-bfb4-08995c83a818 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:33.498791 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b279a921-703c-486b-bfb4-08995c83a818 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:33.499204 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b279a921-703c-486b-bfb4-08995c83a818 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:33.638404 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b279a921-703c-486b-bfb4-08995c83a818 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:33.650570 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b279a921-703c-486b-bfb4-08995c83a818 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:33.652588 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b279a921-703c-486b-bfb4-08995c83a818 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:33.653706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b279a921-703c-486b-bfb4-08995c83a818 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1743 microversion: 2.20 time: 0.172982 Aug 22 05:43:33.654251 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 294/574] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:33 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:34.676812 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-34ddee2e-2d85-4f70-a506-c963add070e8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:34.677535 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-34ddee2e-2d85-4f70-a506-c963add070e8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:34.684264 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34ddee2e-2d85-4f70-a506-c963add070e8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:34.684838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34ddee2e-2d85-4f70-a506-c963add070e8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:34.685421 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34ddee2e-2d85-4f70-a506-c963add070e8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:34.686198 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34ddee2e-2d85-4f70-a506-c963add070e8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:34.686647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34ddee2e-2d85-4f70-a506-c963add070e8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:34.687063 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34ddee2e-2d85-4f70-a506-c963add070e8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:34.749117 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-b41f192e-8352-4820-907d-b27a50e341a3 req-8b58ce92-0245-4cb9-9e17-9fcb8626afe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb", "name": "network-vif-plugged", "status": "completed", "tag": "4c76faf8-d367-4a1e-9d06-cc6e666badde"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:43:34.760708 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b41f192e-8352-4820-907d-b27a50e341a3 req-8b58ce92-0245-4cb9-9e17-9fcb8626afe9 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:34.761688 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b41f192e-8352-4820-907d-b27a50e341a3 req-8b58ce92-0245-4cb9-9e17-9fcb8626afe9 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:34.763512 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b41f192e-8352-4820-907d-b27a50e341a3 req-8b58ce92-0245-4cb9-9e17-9fcb8626afe9 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:34.776509 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-b41f192e-8352-4820-907d-b27a50e341a3 req-8b58ce92-0245-4cb9-9e17-9fcb8626afe9 service nova] Creating event network-vif-plugged:4c76faf8-d367-4a1e-9d06-cc6e666badde for instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb on hv-cinder-85391 Aug 22 05:43:34.785577 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-b41f192e-8352-4820-907d-b27a50e341a3 req-8b58ce92-0245-4cb9-9e17-9fcb8626afe9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039427 Aug 22 05:43:34.786363 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 295/575] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:43:34.828273 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-34ddee2e-2d85-4f70-a506-c963add070e8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:34.836475 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-34ddee2e-2d85-4f70-a506-c963add070e8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:34.837949 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-34ddee2e-2d85-4f70-a506-c963add070e8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:34.839204 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-34ddee2e-2d85-4f70-a506-c963add070e8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1743 microversion: 2.20 time: 0.166322 Aug 22 05:43:34.840444 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 281/576] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:34 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:35.866486 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e2967c45-b692-4242-b5f8-a158008ef8e1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:35.867537 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e2967c45-b692-4242-b5f8-a158008ef8e1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:35.875415 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2967c45-b692-4242-b5f8-a158008ef8e1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:35.876058 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2967c45-b692-4242-b5f8-a158008ef8e1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:35.876801 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2967c45-b692-4242-b5f8-a158008ef8e1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:35.877594 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2967c45-b692-4242-b5f8-a158008ef8e1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:35.878034 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2967c45-b692-4242-b5f8-a158008ef8e1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:35.878443 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2967c45-b692-4242-b5f8-a158008ef8e1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:36.033853 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e2967c45-b692-4242-b5f8-a158008ef8e1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:36.043120 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e2967c45-b692-4242-b5f8-a158008ef8e1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:36.044661 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e2967c45-b692-4242-b5f8-a158008ef8e1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:36.045810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e2967c45-b692-4242-b5f8-a158008ef8e1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1738 microversion: 2.20 time: 0.186653 Aug 22 05:43:36.046332 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 296/577] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:35 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:37.069218 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6c9fe59d-2540-4233-b694-bc774b79ba90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:37.069821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6c9fe59d-2540-4233-b694-bc774b79ba90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:37.076594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c9fe59d-2540-4233-b694-bc774b79ba90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:37.077071 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c9fe59d-2540-4233-b694-bc774b79ba90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:37.077494 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c9fe59d-2540-4233-b694-bc774b79ba90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:37.078181 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c9fe59d-2540-4233-b694-bc774b79ba90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:37.078619 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c9fe59d-2540-4233-b694-bc774b79ba90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:37.079033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c9fe59d-2540-4233-b694-bc774b79ba90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:37.224889 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6c9fe59d-2540-4233-b694-bc774b79ba90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:37.237366 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6c9fe59d-2540-4233-b694-bc774b79ba90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:37.239611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6c9fe59d-2540-4233-b694-bc774b79ba90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:37.240937 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6c9fe59d-2540-4233-b694-bc774b79ba90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1738 microversion: 2.20 time: 0.175668 Aug 22 05:43:37.241447 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 282/578] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:37 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:38.264753 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-9dc60dab-a90f-43e6-9300-d0d1b6141d66 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:38.266327 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-9dc60dab-a90f-43e6-9300-d0d1b6141d66 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:38.273408 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9dc60dab-a90f-43e6-9300-d0d1b6141d66 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:38.274131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9dc60dab-a90f-43e6-9300-d0d1b6141d66 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:38.274776 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9dc60dab-a90f-43e6-9300-d0d1b6141d66 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:38.276083 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9dc60dab-a90f-43e6-9300-d0d1b6141d66 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:38.276537 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9dc60dab-a90f-43e6-9300-d0d1b6141d66 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:38.277356 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9dc60dab-a90f-43e6-9300-d0d1b6141d66 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:38.416264 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-9dc60dab-a90f-43e6-9300-d0d1b6141d66 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:38.425542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-9dc60dab-a90f-43e6-9300-d0d1b6141d66 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:38.427086 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-9dc60dab-a90f-43e6-9300-d0d1b6141d66 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:38.428271 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-9dc60dab-a90f-43e6-9300-d0d1b6141d66 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1738 microversion: 2.20 time: 0.167664 Aug 22 05:43:38.428823 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 297/579] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:38 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:39.451560 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-23ff152b-0e44-425d-b9ee-83f9b474bbca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:39.454061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-23ff152b-0e44-425d-b9ee-83f9b474bbca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:39.459316 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-23ff152b-0e44-425d-b9ee-83f9b474bbca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:39.459832 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-23ff152b-0e44-425d-b9ee-83f9b474bbca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:39.460255 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-23ff152b-0e44-425d-b9ee-83f9b474bbca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:39.460947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-23ff152b-0e44-425d-b9ee-83f9b474bbca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:39.461379 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-23ff152b-0e44-425d-b9ee-83f9b474bbca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:39.461794 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-23ff152b-0e44-425d-b9ee-83f9b474bbca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:39.612080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-23ff152b-0e44-425d-b9ee-83f9b474bbca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:39.631431 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-23ff152b-0e44-425d-b9ee-83f9b474bbca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:39.636374 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-23ff152b-0e44-425d-b9ee-83f9b474bbca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:39.638090 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-23ff152b-0e44-425d-b9ee-83f9b474bbca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1738 microversion: 2.20 time: 0.190576 Aug 22 05:43:39.638781 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 283/580] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:39 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:40.663596 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-488d7a72-84a9-44b6-8d4a-dba736b45e9c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:40.664372 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-488d7a72-84a9-44b6-8d4a-dba736b45e9c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:40.671243 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-488d7a72-84a9-44b6-8d4a-dba736b45e9c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:40.671743 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-488d7a72-84a9-44b6-8d4a-dba736b45e9c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:40.672179 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-488d7a72-84a9-44b6-8d4a-dba736b45e9c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:40.674566 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-488d7a72-84a9-44b6-8d4a-dba736b45e9c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:40.675007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-488d7a72-84a9-44b6-8d4a-dba736b45e9c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:40.675442 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-488d7a72-84a9-44b6-8d4a-dba736b45e9c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:40.823261 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-488d7a72-84a9-44b6-8d4a-dba736b45e9c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:40.832538 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-488d7a72-84a9-44b6-8d4a-dba736b45e9c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:40.834049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-488d7a72-84a9-44b6-8d4a-dba736b45e9c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:40.835230 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-488d7a72-84a9-44b6-8d4a-dba736b45e9c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1738 microversion: 2.20 time: 0.176076 Aug 22 05:43:40.851316 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 298/581] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:40 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:41.859296 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-2be03125-7d90-4028-aad4-43b7b1d978d0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:41.860693 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-2be03125-7d90-4028-aad4-43b7b1d978d0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:41.867830 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2be03125-7d90-4028-aad4-43b7b1d978d0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:41.868379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2be03125-7d90-4028-aad4-43b7b1d978d0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:41.869173 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2be03125-7d90-4028-aad4-43b7b1d978d0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:41.870112 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2be03125-7d90-4028-aad4-43b7b1d978d0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:41.870798 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2be03125-7d90-4028-aad4-43b7b1d978d0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:41.871380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2be03125-7d90-4028-aad4-43b7b1d978d0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:41.993503 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-98b73180-022e-4b3c-83bd-84397922c668 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4953c424-ce7d-4eca-818c-6c54c5a591ec"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:43:41.997081 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-98b73180-022e-4b3c-83bd-84397922c668 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:42.003382 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=27 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:42.005746 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-98b73180-022e-4b3c-83bd-84397922c668 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:42.005746 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-98b73180-022e-4b3c-83bd-84397922c668 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:42.006302 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-98b73180-022e-4b3c-83bd-84397922c668 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:42.007171 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-98b73180-022e-4b3c-83bd-84397922c668 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:42.008050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-98b73180-022e-4b3c-83bd-84397922c668 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:42.008607 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-98b73180-022e-4b3c-83bd-84397922c668 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:42.013832 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=77 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:42.042635 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-2be03125-7d90-4028-aad4-43b7b1d978d0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:42.052495 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-2be03125-7d90-4028-aad4-43b7b1d978d0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:42.055001 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-2be03125-7d90-4028-aad4-43b7b1d978d0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:42.056531 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-2be03125-7d90-4028-aad4-43b7b1d978d0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1738 microversion: 2.20 time: 0.201962 Aug 22 05:43:42.072057 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 299/582] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:41 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 05:43:42.392101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-98b73180-022e-4b3c-83bd-84397922c668 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "POST /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547678 Aug 22 05:43:42.392815 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 284/583] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 22 05:43:41 2022] POST /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/os-volume_attachments => generated 194 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:43:43.081074 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-05f1588d-20e9-46a3-89a0-2abc73706e04 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:43.081717 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-05f1588d-20e9-46a3-89a0-2abc73706e04 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:43.083688 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=31 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:43.088997 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-05f1588d-20e9-46a3-89a0-2abc73706e04 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:43.089486 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-05f1588d-20e9-46a3-89a0-2abc73706e04 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:43.089969 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-05f1588d-20e9-46a3-89a0-2abc73706e04 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:43.091014 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-05f1588d-20e9-46a3-89a0-2abc73706e04 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:43.091472 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-05f1588d-20e9-46a3-89a0-2abc73706e04 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:43.091925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-05f1588d-20e9-46a3-89a0-2abc73706e04 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:43.094711 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:43.227006 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-05f1588d-20e9-46a3-89a0-2abc73706e04 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:43.237917 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-05f1588d-20e9-46a3-89a0-2abc73706e04 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:43.239759 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-05f1588d-20e9-46a3-89a0-2abc73706e04 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:43.240948 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-05f1588d-20e9-46a3-89a0-2abc73706e04 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1738 microversion: 2.20 time: 0.164011 Aug 22 05:43:43.241740 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 300/584] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:43 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:44.269459 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bf61991c-3ec6-4b34-aed5-92d1e7831c00 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:44.270264 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-bf61991c-3ec6-4b34-aed5-92d1e7831c00 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:44.277483 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf61991c-3ec6-4b34-aed5-92d1e7831c00 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:44.277981 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf61991c-3ec6-4b34-aed5-92d1e7831c00 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:44.278430 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf61991c-3ec6-4b34-aed5-92d1e7831c00 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:44.279120 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf61991c-3ec6-4b34-aed5-92d1e7831c00 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:44.279840 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf61991c-3ec6-4b34-aed5-92d1e7831c00 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:44.280421 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf61991c-3ec6-4b34-aed5-92d1e7831c00 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:44.439602 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-bf61991c-3ec6-4b34-aed5-92d1e7831c00 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:44.450193 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-bf61991c-3ec6-4b34-aed5-92d1e7831c00 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:44.452213 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-bf61991c-3ec6-4b34-aed5-92d1e7831c00 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:44.453391 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-bf61991c-3ec6-4b34-aed5-92d1e7831c00 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1738 microversion: 2.20 time: 0.188594 Aug 22 05:43:44.453948 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 285/585] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:44 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:45.476601 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6a9020b5-ae55-4efc-9c8d-6a6136cefc78 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:45.477946 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-6a9020b5-ae55-4efc-9c8d-6a6136cefc78 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:45.485218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a9020b5-ae55-4efc-9c8d-6a6136cefc78 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:45.485802 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a9020b5-ae55-4efc-9c8d-6a6136cefc78 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:45.486291 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a9020b5-ae55-4efc-9c8d-6a6136cefc78 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:45.487041 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a9020b5-ae55-4efc-9c8d-6a6136cefc78 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:45.487485 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a9020b5-ae55-4efc-9c8d-6a6136cefc78 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:45.487927 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a9020b5-ae55-4efc-9c8d-6a6136cefc78 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:45.644377 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6a9020b5-ae55-4efc-9c8d-6a6136cefc78 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:45.653943 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6a9020b5-ae55-4efc-9c8d-6a6136cefc78 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:45.655623 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6a9020b5-ae55-4efc-9c8d-6a6136cefc78 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:45.656636 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6a9020b5-ae55-4efc-9c8d-6a6136cefc78 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1738 microversion: 2.20 time: 0.183955 Aug 22 05:43:45.657775 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 301/586] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:45 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:46.680107 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2dd91a2e-f56f-454c-98d9-975a64bfd863 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:46.680737 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2dd91a2e-f56f-454c-98d9-975a64bfd863 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:46.687162 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2dd91a2e-f56f-454c-98d9-975a64bfd863 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:46.687662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2dd91a2e-f56f-454c-98d9-975a64bfd863 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:46.688101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2dd91a2e-f56f-454c-98d9-975a64bfd863 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:46.688757 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2dd91a2e-f56f-454c-98d9-975a64bfd863 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:46.689195 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2dd91a2e-f56f-454c-98d9-975a64bfd863 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:46.689607 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2dd91a2e-f56f-454c-98d9-975a64bfd863 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:46.833034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2dd91a2e-f56f-454c-98d9-975a64bfd863 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:46.842270 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2dd91a2e-f56f-454c-98d9-975a64bfd863 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:46.843821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2dd91a2e-f56f-454c-98d9-975a64bfd863 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:46.844979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2dd91a2e-f56f-454c-98d9-975a64bfd863 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1738 microversion: 2.20 time: 0.169193 Aug 22 05:43:46.845537 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 286/587] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:46 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:47.871562 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4595f772-6f9d-45ae-a688-f31d7232b9e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:47.872221 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4595f772-6f9d-45ae-a688-f31d7232b9e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:47.880665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4595f772-6f9d-45ae-a688-f31d7232b9e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:47.881326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4595f772-6f9d-45ae-a688-f31d7232b9e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:47.881849 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4595f772-6f9d-45ae-a688-f31d7232b9e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:47.882849 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4595f772-6f9d-45ae-a688-f31d7232b9e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:47.883434 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4595f772-6f9d-45ae-a688-f31d7232b9e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:47.884078 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4595f772-6f9d-45ae-a688-f31d7232b9e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:48.025991 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4595f772-6f9d-45ae-a688-f31d7232b9e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:48.034794 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4595f772-6f9d-45ae-a688-f31d7232b9e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:48.036317 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4595f772-6f9d-45ae-a688-f31d7232b9e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:48.037456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4595f772-6f9d-45ae-a688-f31d7232b9e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1720 microversion: 2.20 time: 0.171370 Aug 22 05:43:48.038008 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 302/588] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:47 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:49.066734 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9b2dc61b-ef2a-4861-be3f-b286fd3e3376 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:49.067626 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9b2dc61b-ef2a-4861-be3f-b286fd3e3376 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:49.077139 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9b2dc61b-ef2a-4861-be3f-b286fd3e3376 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:49.077618 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9b2dc61b-ef2a-4861-be3f-b286fd3e3376 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:49.078043 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9b2dc61b-ef2a-4861-be3f-b286fd3e3376 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:49.078727 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9b2dc61b-ef2a-4861-be3f-b286fd3e3376 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:49.079176 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9b2dc61b-ef2a-4861-be3f-b286fd3e3376 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:49.079605 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9b2dc61b-ef2a-4861-be3f-b286fd3e3376 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:49.209520 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9b2dc61b-ef2a-4861-be3f-b286fd3e3376 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:49.218858 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9b2dc61b-ef2a-4861-be3f-b286fd3e3376 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:49.220386 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9b2dc61b-ef2a-4861-be3f-b286fd3e3376 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:49.221534 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9b2dc61b-ef2a-4861-be3f-b286fd3e3376 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1720 microversion: 2.20 time: 0.161391 Aug 22 05:43:49.222067 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 287/589] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:49 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:50.245403 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-22fa8125-a6e2-44b1-a5a4-464125e56509 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:50.245986 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-22fa8125-a6e2-44b1-a5a4-464125e56509 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:50.253751 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-22fa8125-a6e2-44b1-a5a4-464125e56509 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:50.254234 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-22fa8125-a6e2-44b1-a5a4-464125e56509 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:50.254661 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-22fa8125-a6e2-44b1-a5a4-464125e56509 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:50.255367 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-22fa8125-a6e2-44b1-a5a4-464125e56509 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:50.255847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-22fa8125-a6e2-44b1-a5a4-464125e56509 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:50.256267 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-22fa8125-a6e2-44b1-a5a4-464125e56509 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:50.433255 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-22fa8125-a6e2-44b1-a5a4-464125e56509 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:50.442784 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-22fa8125-a6e2-44b1-a5a4-464125e56509 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:50.444334 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-22fa8125-a6e2-44b1-a5a4-464125e56509 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:50.445540 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-22fa8125-a6e2-44b1-a5a4-464125e56509 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1723 microversion: 2.20 time: 0.204182 Aug 22 05:43:50.446087 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 303/590] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:50 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:50.471694 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0a0d6a3f-b24a-491c-849e-6004e949b5bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db29990f-bb6a-4f9b-9a40-447a84dd8991"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:43:50.474103 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0a0d6a3f-b24a-491c-849e-6004e949b5bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:50.480568 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a0d6a3f-b24a-491c-849e-6004e949b5bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:50.481104 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a0d6a3f-b24a-491c-849e-6004e949b5bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:50.481524 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a0d6a3f-b24a-491c-849e-6004e949b5bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:50.483640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a0d6a3f-b24a-491c-849e-6004e949b5bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:50.484098 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a0d6a3f-b24a-491c-849e-6004e949b5bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:50.484517 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a0d6a3f-b24a-491c-849e-6004e949b5bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:50.803344 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-886918aa-9e81-4bb6-bae5-4054dee8f76c req-e52d3696-c3f2-4649-a0ac-ccd5804000c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb", "name": "network-vif-unplugged", "status": "completed", "tag": "4c76faf8-d367-4a1e-9d06-cc6e666badde"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:43:50.820406 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-886918aa-9e81-4bb6-bae5-4054dee8f76c req-e52d3696-c3f2-4649-a0ac-ccd5804000c1 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:50.821373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-886918aa-9e81-4bb6-bae5-4054dee8f76c req-e52d3696-c3f2-4649-a0ac-ccd5804000c1 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:50.822430 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-886918aa-9e81-4bb6-bae5-4054dee8f76c req-e52d3696-c3f2-4649-a0ac-ccd5804000c1 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:50.841648 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.compute.server_external_events [req-886918aa-9e81-4bb6-bae5-4054dee8f76c req-e52d3696-c3f2-4649-a0ac-ccd5804000c1 service nova] Unable to find a host for instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb. Dropping event network-vif-unplugged {{(pid=132497) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 22 05:43:50.842831 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-886918aa-9e81-4bb6-bae5-4054dee8f76c req-e52d3696-c3f2-4649-a0ac-ccd5804000c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045929 Aug 22 05:43:50.843855 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 304/591] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 22 05:43:50.938432 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0a0d6a3f-b24a-491c-849e-6004e949b5bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "POST /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.470661 Aug 22 05:43:50.944269 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 288/592] 10.222.0.18 () {62 vars in 1364 bytes} [Mon Aug 22 05:43:50 2022] POST /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-volume_attachments => generated 188 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:43:51.081378 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f7dd3b3c-9864-45a5-9158-d7beaccf4b38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:43:51.082127 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9043afd2-8ad4-422e-9748-fe2532459b51 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:43:51.082804 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9043afd2-8ad4-422e-9748-fe2532459b51 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:51.083615 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f7dd3b3c-9864-45a5-9158-d7beaccf4b38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:51.089743 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f7dd3b3c-9864-45a5-9158-d7beaccf4b38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:51.089936 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9043afd2-8ad4-422e-9748-fe2532459b51 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:51.090701 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f7dd3b3c-9864-45a5-9158-d7beaccf4b38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:51.090850 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9043afd2-8ad4-422e-9748-fe2532459b51 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:51.091224 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f7dd3b3c-9864-45a5-9158-d7beaccf4b38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:51.091623 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9043afd2-8ad4-422e-9748-fe2532459b51 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:51.091995 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f7dd3b3c-9864-45a5-9158-d7beaccf4b38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:51.092446 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f7dd3b3c-9864-45a5-9158-d7beaccf4b38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:51.092868 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f7dd3b3c-9864-45a5-9158-d7beaccf4b38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:51.093023 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9043afd2-8ad4-422e-9748-fe2532459b51 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:51.093380 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9043afd2-8ad4-422e-9748-fe2532459b51 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:51.093769 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9043afd2-8ad4-422e-9748-fe2532459b51 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:51.118365 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.objects.instance [None req-f7dd3b3c-9864-45a5-9158-d7beaccf4b38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lazy-loading 'flavor' on Instance uuid 38c93cef-e688-4d2c-ad3d-508c12c362f3 {{(pid=132497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:43:51.189404 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9043afd2-8ad4-422e-9748-fe2532459b51 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132498) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 05:43:51.260762 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f7dd3b3c-9864-45a5-9158-d7beaccf4b38 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "POST /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/action" status: 200 len: 32 microversion: 2.1 time: 0.184031 Aug 22 05:43:51.265953 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 305/593] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 22 05:43:51 2022] POST /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 05:43:51.272957 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9043afd2-8ad4-422e-9748-fe2532459b51 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "POST /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/action" status: 202 len: 0 microversion: 2.20 time: 0.195051 Aug 22 05:43:51.273909 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 289/594] 10.222.0.18 () {62 vars in 1319 bytes} [Mon Aug 22 05:43:51 2022] POST /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 22 05:43:51.277047 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-034777a0-4d0d-4feb-9753-d8b9eded6068 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:51.278638 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-034777a0-4d0d-4feb-9753-d8b9eded6068 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:51.283754 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-80ee1cc5-4eab-45bc-a768-5ee43e0e5f58 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:51.284540 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-80ee1cc5-4eab-45bc-a768-5ee43e0e5f58 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:51.288459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-034777a0-4d0d-4feb-9753-d8b9eded6068 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:51.289128 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-034777a0-4d0d-4feb-9753-d8b9eded6068 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:51.289568 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-034777a0-4d0d-4feb-9753-d8b9eded6068 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:51.290274 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-034777a0-4d0d-4feb-9753-d8b9eded6068 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:51.290805 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-034777a0-4d0d-4feb-9753-d8b9eded6068 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:51.291231 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-034777a0-4d0d-4feb-9753-d8b9eded6068 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:51.292096 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80ee1cc5-4eab-45bc-a768-5ee43e0e5f58 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:51.292584 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80ee1cc5-4eab-45bc-a768-5ee43e0e5f58 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:51.293072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80ee1cc5-4eab-45bc-a768-5ee43e0e5f58 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:51.294246 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80ee1cc5-4eab-45bc-a768-5ee43e0e5f58 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:51.294762 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80ee1cc5-4eab-45bc-a768-5ee43e0e5f58 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:51.295245 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80ee1cc5-4eab-45bc-a768-5ee43e0e5f58 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:51.604679 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-80ee1cc5-4eab-45bc-a768-5ee43e0e5f58 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:51.609221 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-034777a0-4d0d-4feb-9753-d8b9eded6068 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:51.614685 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-80ee1cc5-4eab-45bc-a768-5ee43e0e5f58 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:51.616320 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-80ee1cc5-4eab-45bc-a768-5ee43e0e5f58 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:51.617611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-80ee1cc5-4eab-45bc-a768-5ee43e0e5f58 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1749 microversion: 2.20 time: 0.338978 Aug 22 05:43:51.617748 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-034777a0-4d0d-4feb-9753-d8b9eded6068 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.345310 Aug 22 05:43:51.618273 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 306/595] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:43:51 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:43:51.624877 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 290/596] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:51 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1749 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:52.640419 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-44679bd8-2fb2-4c9c-ba12-eb00dbf30866 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:52.641046 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-44679bd8-2fb2-4c9c-ba12-eb00dbf30866 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:52.642278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1e55f034-c7a4-4e68-9e9a-cdcc51c23be6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:52.642881 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1e55f034-c7a4-4e68-9e9a-cdcc51c23be6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:52.647946 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44679bd8-2fb2-4c9c-ba12-eb00dbf30866 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:52.648429 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44679bd8-2fb2-4c9c-ba12-eb00dbf30866 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:52.648862 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44679bd8-2fb2-4c9c-ba12-eb00dbf30866 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:52.649401 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1e55f034-c7a4-4e68-9e9a-cdcc51c23be6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:52.649556 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44679bd8-2fb2-4c9c-ba12-eb00dbf30866 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:52.649864 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1e55f034-c7a4-4e68-9e9a-cdcc51c23be6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:52.650011 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44679bd8-2fb2-4c9c-ba12-eb00dbf30866 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:52.650288 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1e55f034-c7a4-4e68-9e9a-cdcc51c23be6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:52.650405 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44679bd8-2fb2-4c9c-ba12-eb00dbf30866 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:52.650965 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1e55f034-c7a4-4e68-9e9a-cdcc51c23be6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:52.651400 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1e55f034-c7a4-4e68-9e9a-cdcc51c23be6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:52.651841 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1e55f034-c7a4-4e68-9e9a-cdcc51c23be6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:52.844967 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-44679bd8-2fb2-4c9c-ba12-eb00dbf30866 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:52.848059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1e55f034-c7a4-4e68-9e9a-cdcc51c23be6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:52.853446 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-44679bd8-2fb2-4c9c-ba12-eb00dbf30866 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.217585 Aug 22 05:43:52.854024 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 307/597] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:43:52 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:43:52.866951 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1e55f034-c7a4-4e68-9e9a-cdcc51c23be6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:52.866951 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1e55f034-c7a4-4e68-9e9a-cdcc51c23be6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:52.866951 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1e55f034-c7a4-4e68-9e9a-cdcc51c23be6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1751 microversion: 2.20 time: 0.223038 Aug 22 05:43:52.867287 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 291/598] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:52 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1751 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 05:43:53.521885 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-54cd7158-b4d3-4923-9dd6-42022d90ff36 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:53.522366 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-54cd7158-b4d3-4923-9dd6-42022d90ff36 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:53.529241 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54cd7158-b4d3-4923-9dd6-42022d90ff36 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:53.529731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54cd7158-b4d3-4923-9dd6-42022d90ff36 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:53.530165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54cd7158-b4d3-4923-9dd6-42022d90ff36 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:53.531026 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54cd7158-b4d3-4923-9dd6-42022d90ff36 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:53.531452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54cd7158-b4d3-4923-9dd6-42022d90ff36 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:53.531898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-54cd7158-b4d3-4923-9dd6-42022d90ff36 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:53.657822 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-54cd7158-b4d3-4923-9dd6-42022d90ff36 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lazy-loading 'services' on Instance uuid 585fdc4d-a711-4748-9480-bb5a9bab88f4 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:43:53.775416 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-54cd7158-b4d3-4923-9dd6-42022d90ff36 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "DELETE /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/os-volume_attachments/6b54e9e5-ad41-4fbc-b291-0e76b1c8e2e2" status: 202 len: 0 microversion: 2.1 time: 0.375531 Aug 22 05:43:53.776314 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 292/599] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 22 05:43:53 2022] DELETE /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/os-volume_attachments/6b54e9e5-ad41-4fbc-b291-0e76b1c8e2e2 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:43:53.874942 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-10e466dd-5a42-41e8-a00f-cb056af2ac43 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:53.876316 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-10e466dd-5a42-41e8-a00f-cb056af2ac43 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:53.888981 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fc0aa59e-e864-4792-9c6a-e1b767b329ba tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:53.895096 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fc0aa59e-e864-4792-9c6a-e1b767b329ba tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:53.901902 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-10e466dd-5a42-41e8-a00f-cb056af2ac43 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:53.902459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-10e466dd-5a42-41e8-a00f-cb056af2ac43 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:53.903099 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-10e466dd-5a42-41e8-a00f-cb056af2ac43 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:53.904251 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-10e466dd-5a42-41e8-a00f-cb056af2ac43 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:53.904855 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-10e466dd-5a42-41e8-a00f-cb056af2ac43 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:53.905437 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-10e466dd-5a42-41e8-a00f-cb056af2ac43 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:53.906147 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc0aa59e-e864-4792-9c6a-e1b767b329ba tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:53.906638 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc0aa59e-e864-4792-9c6a-e1b767b329ba tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:53.907074 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc0aa59e-e864-4792-9c6a-e1b767b329ba tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:53.907834 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc0aa59e-e864-4792-9c6a-e1b767b329ba tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:53.908289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc0aa59e-e864-4792-9c6a-e1b767b329ba tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:53.908710 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc0aa59e-e864-4792-9c6a-e1b767b329ba tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:54.125558 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fc0aa59e-e864-4792-9c6a-e1b767b329ba tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:54.129659 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-10e466dd-5a42-41e8-a00f-cb056af2ac43 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:54.134553 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fc0aa59e-e864-4792-9c6a-e1b767b329ba tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:54.136038 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fc0aa59e-e864-4792-9c6a-e1b767b329ba tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:54.137305 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fc0aa59e-e864-4792-9c6a-e1b767b329ba tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.252825 Aug 22 05:43:54.137871 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 293/600] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:53 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:54.138848 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-10e466dd-5a42-41e8-a00f-cb056af2ac43 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.268373 Aug 22 05:43:54.139446 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 308/601] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:43:53 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:43:54.946814 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f2bd885d-dde2-4a2e-a3d7-17be6f9dd4de tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:43:54.954716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2bd885d-dde2-4a2e-a3d7-17be6f9dd4de tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:54.955196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2bd885d-dde2-4a2e-a3d7-17be6f9dd4de tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:54.955660 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2bd885d-dde2-4a2e-a3d7-17be6f9dd4de tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:54.984626 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f2bd885d-dde2-4a2e-a3d7-17be6f9dd4de tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Going to try to stop instance {{(pid=132498) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 22 05:43:55.003404 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=7,nova_cell1:INSERT=6 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:55.044420 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f2bd885d-dde2-4a2e-a3d7-17be6f9dd4de tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "POST /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/action" status: 202 len: 0 microversion: 2.1 time: 0.103809 Aug 22 05:43:55.045365 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 294/602] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 22 05:43:54 2022] POST /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:43:55.055352 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-60eb8477-12cb-4c5b-979d-46b4ba49aa35 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:55.056497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-60eb8477-12cb-4c5b-979d-46b4ba49aa35 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:55.064563 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-60eb8477-12cb-4c5b-979d-46b4ba49aa35 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:55.065522 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-60eb8477-12cb-4c5b-979d-46b4ba49aa35 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:55.066191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-60eb8477-12cb-4c5b-979d-46b4ba49aa35 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:55.067174 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-60eb8477-12cb-4c5b-979d-46b4ba49aa35 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:55.067869 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-60eb8477-12cb-4c5b-979d-46b4ba49aa35 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:55.068496 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-60eb8477-12cb-4c5b-979d-46b4ba49aa35 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:55.161840 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-07e64a5a-4f50-4c20-bfb0-58e70473f369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:55.162535 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-07e64a5a-4f50-4c20-bfb0-58e70473f369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:55.169517 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-07e64a5a-4f50-4c20-bfb0-58e70473f369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:55.170397 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-07e64a5a-4f50-4c20-bfb0-58e70473f369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:55.171096 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-07e64a5a-4f50-4c20-bfb0-58e70473f369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:55.171981 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-07e64a5a-4f50-4c20-bfb0-58e70473f369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:55.172579 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-07e64a5a-4f50-4c20-bfb0-58e70473f369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:55.173152 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-07e64a5a-4f50-4c20-bfb0-58e70473f369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:55.235786 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-60eb8477-12cb-4c5b-979d-46b4ba49aa35 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:55.251941 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-60eb8477-12cb-4c5b-979d-46b4ba49aa35 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.201735 Aug 22 05:43:55.252724 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 309/603] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:43:55 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:43:55.264639 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-3a53c799-0e1d-469b-984f-c4ac3413e355 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:55.265427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-3a53c799-0e1d-469b-984f-c4ac3413e355 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:55.271760 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3a53c799-0e1d-469b-984f-c4ac3413e355 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:55.272332 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3a53c799-0e1d-469b-984f-c4ac3413e355 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:55.273086 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3a53c799-0e1d-469b-984f-c4ac3413e355 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:55.273842 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3a53c799-0e1d-469b-984f-c4ac3413e355 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:55.274443 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3a53c799-0e1d-469b-984f-c4ac3413e355 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:55.274852 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3a53c799-0e1d-469b-984f-c4ac3413e355 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:55.345233 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-07e64a5a-4f50-4c20-bfb0-58e70473f369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:55.354579 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-07e64a5a-4f50-4c20-bfb0-58e70473f369 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.196892 Aug 22 05:43:55.356093 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 295/604] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:43:55 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:43:55.697921 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-3a53c799-0e1d-469b-984f-c4ac3413e355 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:55.707512 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-3a53c799-0e1d-469b-984f-c4ac3413e355 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:55.717590 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-3a53c799-0e1d-469b-984f-c4ac3413e355 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:55.718807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-3a53c799-0e1d-469b-984f-c4ac3413e355 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.458126 Aug 22 05:43:55.722701 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 310/605] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:55 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:56.274355 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4b0fc329-0b36-44b0-85c3-4e42838ca9d0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:56.274953 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4b0fc329-0b36-44b0-85c3-4e42838ca9d0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:56.282651 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b0fc329-0b36-44b0-85c3-4e42838ca9d0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:56.283423 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b0fc329-0b36-44b0-85c3-4e42838ca9d0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:56.284096 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b0fc329-0b36-44b0-85c3-4e42838ca9d0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:56.284764 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b0fc329-0b36-44b0-85c3-4e42838ca9d0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:56.285376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b0fc329-0b36-44b0-85c3-4e42838ca9d0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:56.285787 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b0fc329-0b36-44b0-85c3-4e42838ca9d0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:56.376853 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-43956e0d-5740-4d38-bb15-bdf3c5ffbda7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:56.378266 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-43956e0d-5740-4d38-bb15-bdf3c5ffbda7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:56.386182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-43956e0d-5740-4d38-bb15-bdf3c5ffbda7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:56.387244 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-43956e0d-5740-4d38-bb15-bdf3c5ffbda7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:56.387934 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-43956e0d-5740-4d38-bb15-bdf3c5ffbda7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:56.388879 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-43956e0d-5740-4d38-bb15-bdf3c5ffbda7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:56.389666 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-43956e0d-5740-4d38-bb15-bdf3c5ffbda7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:56.390278 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-43956e0d-5740-4d38-bb15-bdf3c5ffbda7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:56.475614 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4b0fc329-0b36-44b0-85c3-4e42838ca9d0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:56.487823 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4b0fc329-0b36-44b0-85c3-4e42838ca9d0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.217169 Aug 22 05:43:56.490525 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 296/606] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:43:56 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:43:56.549927 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-43956e0d-5740-4d38-bb15-bdf3c5ffbda7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:56.559154 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-43956e0d-5740-4d38-bb15-bdf3c5ffbda7 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.186313 Aug 22 05:43:56.573003 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 311/607] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:43:56 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:43:56.742727 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0b56ca61-f327-42ed-bf1c-02e3f75c3bd9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:56.743937 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0b56ca61-f327-42ed-bf1c-02e3f75c3bd9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:56.751507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b56ca61-f327-42ed-bf1c-02e3f75c3bd9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:56.752022 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b56ca61-f327-42ed-bf1c-02e3f75c3bd9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:56.752452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b56ca61-f327-42ed-bf1c-02e3f75c3bd9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:56.753154 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b56ca61-f327-42ed-bf1c-02e3f75c3bd9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:56.753598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b56ca61-f327-42ed-bf1c-02e3f75c3bd9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:56.754015 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0b56ca61-f327-42ed-bf1c-02e3f75c3bd9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:56.904687 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0b56ca61-f327-42ed-bf1c-02e3f75c3bd9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:56.913914 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0b56ca61-f327-42ed-bf1c-02e3f75c3bd9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:56.915391 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0b56ca61-f327-42ed-bf1c-02e3f75c3bd9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:56.916595 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0b56ca61-f327-42ed-bf1c-02e3f75c3bd9 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.178054 Aug 22 05:43:56.917142 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 297/608] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:56 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:57.511026 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-84fc673e-64e2-45f5-abf0-38aadc64d0aa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:57.511673 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-84fc673e-64e2-45f5-abf0-38aadc64d0aa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:57.518394 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-84fc673e-64e2-45f5-abf0-38aadc64d0aa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:57.518873 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-84fc673e-64e2-45f5-abf0-38aadc64d0aa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:57.519304 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-84fc673e-64e2-45f5-abf0-38aadc64d0aa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:57.520018 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-84fc673e-64e2-45f5-abf0-38aadc64d0aa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:57.520467 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-84fc673e-64e2-45f5-abf0-38aadc64d0aa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:57.520881 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-84fc673e-64e2-45f5-abf0-38aadc64d0aa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:57.580404 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-40b76dfd-fb43-45a6-873f-2b57d2ac720b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:57.580998 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-40b76dfd-fb43-45a6-873f-2b57d2ac720b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:57.596593 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40b76dfd-fb43-45a6-873f-2b57d2ac720b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:57.597091 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40b76dfd-fb43-45a6-873f-2b57d2ac720b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:57.597528 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40b76dfd-fb43-45a6-873f-2b57d2ac720b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:57.598248 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40b76dfd-fb43-45a6-873f-2b57d2ac720b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:57.598699 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40b76dfd-fb43-45a6-873f-2b57d2ac720b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:57.599121 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40b76dfd-fb43-45a6-873f-2b57d2ac720b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:57.751514 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-84fc673e-64e2-45f5-abf0-38aadc64d0aa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:57.759776 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-84fc673e-64e2-45f5-abf0-38aadc64d0aa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.252665 Aug 22 05:43:57.773834 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 312/609] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:43:57 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:43:57.780661 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-40b76dfd-fb43-45a6-873f-2b57d2ac720b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:57.790154 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-40b76dfd-fb43-45a6-873f-2b57d2ac720b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.213513 Aug 22 05:43:57.790816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 298/610] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:43:57 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:43:57.942833 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-88306f78-117b-4fff-90be-30b4bde4367c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:57.943472 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-88306f78-117b-4fff-90be-30b4bde4367c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:57.950597 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-88306f78-117b-4fff-90be-30b4bde4367c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:57.951073 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-88306f78-117b-4fff-90be-30b4bde4367c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:57.951499 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-88306f78-117b-4fff-90be-30b4bde4367c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:57.952209 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-88306f78-117b-4fff-90be-30b4bde4367c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:57.952652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-88306f78-117b-4fff-90be-30b4bde4367c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:57.953061 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-88306f78-117b-4fff-90be-30b4bde4367c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:58.112352 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-88306f78-117b-4fff-90be-30b4bde4367c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:58.121958 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-88306f78-117b-4fff-90be-30b4bde4367c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:58.123520 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-88306f78-117b-4fff-90be-30b4bde4367c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:58.124781 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-88306f78-117b-4fff-90be-30b4bde4367c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.185951 Aug 22 05:43:58.125539 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 313/611] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:57 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:43:58.783655 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c22989e7-fac1-4143-ba31-1d6d2eef0a24 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:58.784452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c22989e7-fac1-4143-ba31-1d6d2eef0a24 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:58.791403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c22989e7-fac1-4143-ba31-1d6d2eef0a24 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:58.791968 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c22989e7-fac1-4143-ba31-1d6d2eef0a24 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:58.792397 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c22989e7-fac1-4143-ba31-1d6d2eef0a24 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:58.793088 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c22989e7-fac1-4143-ba31-1d6d2eef0a24 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:58.793569 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c22989e7-fac1-4143-ba31-1d6d2eef0a24 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:58.794070 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c22989e7-fac1-4143-ba31-1d6d2eef0a24 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:58.813550 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4c645e80-5d00-4be7-b013-1adfa8dfb4cc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:58.814197 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4c645e80-5d00-4be7-b013-1adfa8dfb4cc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:58.822595 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c645e80-5d00-4be7-b013-1adfa8dfb4cc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:58.823763 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c645e80-5d00-4be7-b013-1adfa8dfb4cc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:58.824689 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c645e80-5d00-4be7-b013-1adfa8dfb4cc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:58.825687 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c645e80-5d00-4be7-b013-1adfa8dfb4cc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:58.826380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c645e80-5d00-4be7-b013-1adfa8dfb4cc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:58.827050 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4c645e80-5d00-4be7-b013-1adfa8dfb4cc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:59.014905 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c22989e7-fac1-4143-ba31-1d6d2eef0a24 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:59.023004 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c22989e7-fac1-4143-ba31-1d6d2eef0a24 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.245196 Aug 22 05:43:59.024015 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 299/612] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:43:58 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:43:59.043284 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4c645e80-5d00-4be7-b013-1adfa8dfb4cc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:59.051883 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4c645e80-5d00-4be7-b013-1adfa8dfb4cc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.242218 Aug 22 05:43:59.052419 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 314/613] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:43:58 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:43:59.158210 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bdcf4c79-af35-4aed-b1b1-4e184b5e8cc3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:43:59.158821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-bdcf4c79-af35-4aed-b1b1-4e184b5e8cc3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:43:59.175216 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bdcf4c79-af35-4aed-b1b1-4e184b5e8cc3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:59.175759 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bdcf4c79-af35-4aed-b1b1-4e184b5e8cc3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:59.176187 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bdcf4c79-af35-4aed-b1b1-4e184b5e8cc3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:59.176882 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bdcf4c79-af35-4aed-b1b1-4e184b5e8cc3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:43:59.177444 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bdcf4c79-af35-4aed-b1b1-4e184b5e8cc3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:43:59.177740 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bdcf4c79-af35-4aed-b1b1-4e184b5e8cc3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:43:59.326490 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-bdcf4c79-af35-4aed-b1b1-4e184b5e8cc3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:59.335884 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-bdcf4c79-af35-4aed-b1b1-4e184b5e8cc3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:59.337376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-bdcf4c79-af35-4aed-b1b1-4e184b5e8cc3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:43:59.338542 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-bdcf4c79-af35-4aed-b1b1-4e184b5e8cc3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.184323 Aug 22 05:43:59.339310 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 300/614] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:43:59 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:00.044724 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-44fb03bd-8659-4b28-b4a9-891abbf19d86 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:00.045356 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-44fb03bd-8659-4b28-b4a9-891abbf19d86 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:00.057302 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44fb03bd-8659-4b28-b4a9-891abbf19d86 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:00.057780 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44fb03bd-8659-4b28-b4a9-891abbf19d86 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:00.058369 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44fb03bd-8659-4b28-b4a9-891abbf19d86 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:00.059109 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44fb03bd-8659-4b28-b4a9-891abbf19d86 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:00.059550 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44fb03bd-8659-4b28-b4a9-891abbf19d86 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:00.060036 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-44fb03bd-8659-4b28-b4a9-891abbf19d86 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:00.075367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f55e9807-d834-4642-942b-3b027e300c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:00.077258 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:00.078434 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f55e9807-d834-4642-942b-3b027e300c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:00.087289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f55e9807-d834-4642-942b-3b027e300c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:00.088540 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f55e9807-d834-4642-942b-3b027e300c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:00.089209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f55e9807-d834-4642-942b-3b027e300c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:00.090147 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f55e9807-d834-4642-942b-3b027e300c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:00.091322 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f55e9807-d834-4642-942b-3b027e300c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:00.092406 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f55e9807-d834-4642-942b-3b027e300c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:00.277661 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-44fb03bd-8659-4b28-b4a9-891abbf19d86 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:00.286784 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-44fb03bd-8659-4b28-b4a9-891abbf19d86 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.246576 Aug 22 05:44:00.287833 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 315/615] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:00 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:00.302735 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f55e9807-d834-4642-942b-3b027e300c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:00.311633 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f55e9807-d834-4642-942b-3b027e300c16 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.240874 Aug 22 05:44:00.312336 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 301/616] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:00 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:00.367748 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-faa2056a-641e-4896-9790-838fdd173d21 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:00.368637 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-faa2056a-641e-4896-9790-838fdd173d21 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:00.376453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-faa2056a-641e-4896-9790-838fdd173d21 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:00.376942 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-faa2056a-641e-4896-9790-838fdd173d21 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:00.377370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-faa2056a-641e-4896-9790-838fdd173d21 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:00.378066 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-faa2056a-641e-4896-9790-838fdd173d21 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:00.378517 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-faa2056a-641e-4896-9790-838fdd173d21 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:00.378932 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-faa2056a-641e-4896-9790-838fdd173d21 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:00.541286 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-faa2056a-641e-4896-9790-838fdd173d21 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:00.550410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-faa2056a-641e-4896-9790-838fdd173d21 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:00.551877 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-faa2056a-641e-4896-9790-838fdd173d21 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:00.553048 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-faa2056a-641e-4896-9790-838fdd173d21 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.192080 Aug 22 05:44:00.553610 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 316/617] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:00 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:01.313388 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e11f1230-290d-4cd9-afe0-090ae9b74782 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:01.313990 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e11f1230-290d-4cd9-afe0-090ae9b74782 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:01.321252 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e11f1230-290d-4cd9-afe0-090ae9b74782 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:01.321761 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e11f1230-290d-4cd9-afe0-090ae9b74782 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:01.322377 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e11f1230-290d-4cd9-afe0-090ae9b74782 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:01.322911 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e11f1230-290d-4cd9-afe0-090ae9b74782 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:01.323355 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e11f1230-290d-4cd9-afe0-090ae9b74782 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:01.323800 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e11f1230-290d-4cd9-afe0-090ae9b74782 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:01.336912 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6d6837a5-0302-4855-a75b-8dbf1840629a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:01.337817 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-6d6837a5-0302-4855-a75b-8dbf1840629a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:01.345654 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6d6837a5-0302-4855-a75b-8dbf1840629a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:01.346229 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6d6837a5-0302-4855-a75b-8dbf1840629a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:01.346869 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6d6837a5-0302-4855-a75b-8dbf1840629a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:01.348596 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6d6837a5-0302-4855-a75b-8dbf1840629a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:01.349133 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6d6837a5-0302-4855-a75b-8dbf1840629a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:01.349637 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6d6837a5-0302-4855-a75b-8dbf1840629a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:01.549562 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e11f1230-290d-4cd9-afe0-090ae9b74782 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:01.561569 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e11f1230-290d-4cd9-afe0-090ae9b74782 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.252236 Aug 22 05:44:01.562716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 302/618] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:01 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:01.576368 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6d6837a5-0302-4855-a75b-8dbf1840629a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:01.582704 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3423257b-8f13-4693-8220-e2aaf6fcbedc tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:01.583890 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3423257b-8f13-4693-8220-e2aaf6fcbedc tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:01.586415 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6d6837a5-0302-4855-a75b-8dbf1840629a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.253391 Aug 22 05:44:01.587606 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 317/619] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:01 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:01.593834 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3423257b-8f13-4693-8220-e2aaf6fcbedc tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:01.594566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3423257b-8f13-4693-8220-e2aaf6fcbedc tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:01.595161 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3423257b-8f13-4693-8220-e2aaf6fcbedc tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:01.596054 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3423257b-8f13-4693-8220-e2aaf6fcbedc tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:01.596646 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3423257b-8f13-4693-8220-e2aaf6fcbedc tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:01.597571 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3423257b-8f13-4693-8220-e2aaf6fcbedc tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:01.749278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3423257b-8f13-4693-8220-e2aaf6fcbedc tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:01.758378 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3423257b-8f13-4693-8220-e2aaf6fcbedc tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:01.759909 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3423257b-8f13-4693-8220-e2aaf6fcbedc tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:01.761056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3423257b-8f13-4693-8220-e2aaf6fcbedc tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.183348 Aug 22 05:44:01.761968 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 303/620] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:01 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:02.585272 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8e83017e-770c-4260-91e6-7bf0f3392568 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:02.585957 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8e83017e-770c-4260-91e6-7bf0f3392568 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:02.594663 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e83017e-770c-4260-91e6-7bf0f3392568 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:02.595143 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e83017e-770c-4260-91e6-7bf0f3392568 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:02.595602 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e83017e-770c-4260-91e6-7bf0f3392568 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:02.596364 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e83017e-770c-4260-91e6-7bf0f3392568 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:02.596813 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e83017e-770c-4260-91e6-7bf0f3392568 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:02.597229 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e83017e-770c-4260-91e6-7bf0f3392568 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:02.609617 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-25ec32cb-6439-40a3-ac32-eb71824494bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:02.610376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-25ec32cb-6439-40a3-ac32-eb71824494bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:02.617076 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-25ec32cb-6439-40a3-ac32-eb71824494bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:02.617552 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-25ec32cb-6439-40a3-ac32-eb71824494bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:02.617977 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-25ec32cb-6439-40a3-ac32-eb71824494bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:02.618635 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-25ec32cb-6439-40a3-ac32-eb71824494bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:02.619097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-25ec32cb-6439-40a3-ac32-eb71824494bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:02.619507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-25ec32cb-6439-40a3-ac32-eb71824494bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:02.799479 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8e83017e-770c-4260-91e6-7bf0f3392568 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:02.804660 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-25ec32cb-6439-40a3-ac32-eb71824494bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:02.810979 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8e83017e-770c-4260-91e6-7bf0f3392568 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.230394 Aug 22 05:44:02.811777 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 318/621] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:02 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:02.815480 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-25ec32cb-6439-40a3-ac32-eb71824494bf tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.209914 Aug 22 05:44:02.816053 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 304/622] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:02 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:02.816639 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6fe5b0db-7f81-4643-a98c-2216bcd8f5d4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:02.817299 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-6fe5b0db-7f81-4643-a98c-2216bcd8f5d4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:02.823349 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6fe5b0db-7f81-4643-a98c-2216bcd8f5d4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:02.823833 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6fe5b0db-7f81-4643-a98c-2216bcd8f5d4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:02.824264 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6fe5b0db-7f81-4643-a98c-2216bcd8f5d4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:02.825362 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6fe5b0db-7f81-4643-a98c-2216bcd8f5d4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:02.826185 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6fe5b0db-7f81-4643-a98c-2216bcd8f5d4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:02.826600 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6fe5b0db-7f81-4643-a98c-2216bcd8f5d4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:02.964488 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6fe5b0db-7f81-4643-a98c-2216bcd8f5d4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:02.974364 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6fe5b0db-7f81-4643-a98c-2216bcd8f5d4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:02.975906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6fe5b0db-7f81-4643-a98c-2216bcd8f5d4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:02.977051 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6fe5b0db-7f81-4643-a98c-2216bcd8f5d4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.164270 Aug 22 05:44:02.977600 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 319/623] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:02 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:03.832443 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-cc607529-faf0-4430-a7a3-4750b777280d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:03.833092 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-cc607529-faf0-4430-a7a3-4750b777280d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:03.836511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b7bddd46-9c85-4e0d-8a40-0845b9b6fa63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:03.837140 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b7bddd46-9c85-4e0d-8a40-0845b9b6fa63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:03.840062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc607529-faf0-4430-a7a3-4750b777280d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:03.841407 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc607529-faf0-4430-a7a3-4750b777280d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:03.841740 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc607529-faf0-4430-a7a3-4750b777280d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:03.842448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc607529-faf0-4430-a7a3-4750b777280d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:03.842909 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc607529-faf0-4430-a7a3-4750b777280d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:03.843331 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc607529-faf0-4430-a7a3-4750b777280d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:03.844211 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7bddd46-9c85-4e0d-8a40-0845b9b6fa63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:03.844690 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7bddd46-9c85-4e0d-8a40-0845b9b6fa63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:03.845120 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7bddd46-9c85-4e0d-8a40-0845b9b6fa63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:03.845807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7bddd46-9c85-4e0d-8a40-0845b9b6fa63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:03.846257 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7bddd46-9c85-4e0d-8a40-0845b9b6fa63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:03.846671 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7bddd46-9c85-4e0d-8a40-0845b9b6fa63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:04.039097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-cc607529-faf0-4430-a7a3-4750b777280d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:04.043281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b7bddd46-9c85-4e0d-8a40-0845b9b6fa63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:04.047978 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-cc607529-faf0-4430-a7a3-4750b777280d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.219417 Aug 22 05:44:04.048548 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 305/624] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:03 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:04.053097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3f89ca25-dc00-4427-a2f4-b835a8228996 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:04.053701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3f89ca25-dc00-4427-a2f4-b835a8228996 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:04.053969 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b7bddd46-9c85-4e0d-8a40-0845b9b6fa63 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.220782 Aug 22 05:44:04.054688 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 320/625] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:03 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:04.062827 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f89ca25-dc00-4427-a2f4-b835a8228996 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:04.063306 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f89ca25-dc00-4427-a2f4-b835a8228996 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:04.063841 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f89ca25-dc00-4427-a2f4-b835a8228996 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:04.064586 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f89ca25-dc00-4427-a2f4-b835a8228996 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:04.065033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f89ca25-dc00-4427-a2f4-b835a8228996 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:04.065444 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f89ca25-dc00-4427-a2f4-b835a8228996 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:04.213635 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3f89ca25-dc00-4427-a2f4-b835a8228996 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:04.222777 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3f89ca25-dc00-4427-a2f4-b835a8228996 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:04.224273 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3f89ca25-dc00-4427-a2f4-b835a8228996 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:04.225456 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3f89ca25-dc00-4427-a2f4-b835a8228996 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.175956 Aug 22 05:44:04.226026 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 306/626] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:04 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:05.071311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f49b3eb3-fc4a-4120-9ac9-65fec69802fa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:05.071944 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f49b3eb3-fc4a-4120-9ac9-65fec69802fa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:05.075272 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c2886a92-3d2f-4b81-861d-df6c9ae9303e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:05.076398 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c2886a92-3d2f-4b81-861d-df6c9ae9303e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:05.079164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f49b3eb3-fc4a-4120-9ac9-65fec69802fa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:05.079696 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f49b3eb3-fc4a-4120-9ac9-65fec69802fa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:05.080258 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f49b3eb3-fc4a-4120-9ac9-65fec69802fa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:05.080882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f49b3eb3-fc4a-4120-9ac9-65fec69802fa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:05.081267 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f49b3eb3-fc4a-4120-9ac9-65fec69802fa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:05.081678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f49b3eb3-fc4a-4120-9ac9-65fec69802fa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:05.084121 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c2886a92-3d2f-4b81-861d-df6c9ae9303e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:05.084807 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c2886a92-3d2f-4b81-861d-df6c9ae9303e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:05.085251 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c2886a92-3d2f-4b81-861d-df6c9ae9303e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:05.087649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c2886a92-3d2f-4b81-861d-df6c9ae9303e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:05.088176 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c2886a92-3d2f-4b81-861d-df6c9ae9303e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:05.088613 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c2886a92-3d2f-4b81-861d-df6c9ae9303e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:05.284377 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-f49b3eb3-fc4a-4120-9ac9-65fec69802fa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:05.287358 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c2886a92-3d2f-4b81-861d-df6c9ae9303e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:05.292425 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f49b3eb3-fc4a-4120-9ac9-65fec69802fa tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.226481 Aug 22 05:44:05.293038 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 321/627] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:05 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:05.296613 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c2886a92-3d2f-4b81-861d-df6c9ae9303e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.225134 Aug 22 05:44:05.297159 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 307/628] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:05 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:05.298587 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-34cf54ab-b906-4282-8571-ac26c5165b45 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:05.299198 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-34cf54ab-b906-4282-8571-ac26c5165b45 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:05.305496 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-34cf54ab-b906-4282-8571-ac26c5165b45 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:05.305971 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-34cf54ab-b906-4282-8571-ac26c5165b45 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:05.306395 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-34cf54ab-b906-4282-8571-ac26c5165b45 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:05.307065 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-34cf54ab-b906-4282-8571-ac26c5165b45 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:05.307504 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-34cf54ab-b906-4282-8571-ac26c5165b45 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:05.308064 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-34cf54ab-b906-4282-8571-ac26c5165b45 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:05.446888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-34cf54ab-b906-4282-8571-ac26c5165b45 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:05.457111 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-34cf54ab-b906-4282-8571-ac26c5165b45 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:05.458602 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-34cf54ab-b906-4282-8571-ac26c5165b45 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:05.459793 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-34cf54ab-b906-4282-8571-ac26c5165b45 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.165804 Aug 22 05:44:05.460346 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 322/629] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:05 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:06.317074 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f85b190d-79f3-4f25-96fb-70b782bc872a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:06.317665 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f85b190d-79f3-4f25-96fb-70b782bc872a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:06.317767 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-2391e772-1981-4656-a2ae-c3a69bb5691d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:06.318371 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-2391e772-1981-4656-a2ae-c3a69bb5691d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:06.324409 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f85b190d-79f3-4f25-96fb-70b782bc872a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:06.324885 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f85b190d-79f3-4f25-96fb-70b782bc872a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:06.324990 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2391e772-1981-4656-a2ae-c3a69bb5691d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:06.325338 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f85b190d-79f3-4f25-96fb-70b782bc872a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:06.325449 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2391e772-1981-4656-a2ae-c3a69bb5691d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:06.325847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2391e772-1981-4656-a2ae-c3a69bb5691d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:06.325996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f85b190d-79f3-4f25-96fb-70b782bc872a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:06.326485 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f85b190d-79f3-4f25-96fb-70b782bc872a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:06.326908 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f85b190d-79f3-4f25-96fb-70b782bc872a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:06.327034 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2391e772-1981-4656-a2ae-c3a69bb5691d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:06.327492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2391e772-1981-4656-a2ae-c3a69bb5691d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:06.327945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2391e772-1981-4656-a2ae-c3a69bb5691d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:06.533473 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f85b190d-79f3-4f25-96fb-70b782bc872a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:06.538606 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-2391e772-1981-4656-a2ae-c3a69bb5691d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:06.545262 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f85b190d-79f3-4f25-96fb-70b782bc872a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.231837 Aug 22 05:44:06.546209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 308/630] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:06 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:06.550298 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-2391e772-1981-4656-a2ae-c3a69bb5691d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.236291 Aug 22 05:44:06.550861 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e23ef3a5-b8b5-4396-bdda-bc58076a2f69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:06.551144 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 323/631] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:06 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:06.551517 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e23ef3a5-b8b5-4396-bdda-bc58076a2f69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:06.557636 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e23ef3a5-b8b5-4396-bdda-bc58076a2f69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:06.558115 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e23ef3a5-b8b5-4396-bdda-bc58076a2f69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:06.558544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e23ef3a5-b8b5-4396-bdda-bc58076a2f69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:06.559256 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e23ef3a5-b8b5-4396-bdda-bc58076a2f69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:06.559740 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e23ef3a5-b8b5-4396-bdda-bc58076a2f69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:06.560126 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e23ef3a5-b8b5-4396-bdda-bc58076a2f69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:06.703929 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e23ef3a5-b8b5-4396-bdda-bc58076a2f69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:06.713217 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e23ef3a5-b8b5-4396-bdda-bc58076a2f69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:06.714696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e23ef3a5-b8b5-4396-bdda-bc58076a2f69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:06.716250 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e23ef3a5-b8b5-4396-bdda-bc58076a2f69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.168927 Aug 22 05:44:06.717160 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 309/632] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:06 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:07.570745 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-d787b601-8363-4675-8361-1db13f2f56c6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:07.571324 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-d787b601-8363-4675-8361-1db13f2f56c6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:07.571549 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-82168ff6-177c-458f-ae1a-55b0cac83e32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:07.572170 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-82168ff6-177c-458f-ae1a-55b0cac83e32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:07.578604 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d787b601-8363-4675-8361-1db13f2f56c6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:07.579081 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d787b601-8363-4675-8361-1db13f2f56c6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:07.579221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-82168ff6-177c-458f-ae1a-55b0cac83e32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:07.579496 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d787b601-8363-4675-8361-1db13f2f56c6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:07.579658 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-82168ff6-177c-458f-ae1a-55b0cac83e32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:07.580059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-82168ff6-177c-458f-ae1a-55b0cac83e32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:07.580210 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d787b601-8363-4675-8361-1db13f2f56c6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:07.580682 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d787b601-8363-4675-8361-1db13f2f56c6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:07.580838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-82168ff6-177c-458f-ae1a-55b0cac83e32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:07.581100 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d787b601-8363-4675-8361-1db13f2f56c6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:07.581245 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-82168ff6-177c-458f-ae1a-55b0cac83e32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:07.581564 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-82168ff6-177c-458f-ae1a-55b0cac83e32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:07.782510 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-82168ff6-177c-458f-ae1a-55b0cac83e32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:07.784358 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-d787b601-8363-4675-8361-1db13f2f56c6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:07.785001 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:07.793054 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-82168ff6-177c-458f-ae1a-55b0cac83e32 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.225250 Aug 22 05:44:07.793273 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-d787b601-8363-4675-8361-1db13f2f56c6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.226297 Aug 22 05:44:07.801964 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 324/633] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:07 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:07.802162 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 310/634] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:07 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:07.802271 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-d59d6089-d85a-4ad6-81b4-118ac9c9d4e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:07.802271 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-d59d6089-d85a-4ad6-81b4-118ac9c9d4e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:07.805255 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d59d6089-d85a-4ad6-81b4-118ac9c9d4e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:07.805741 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d59d6089-d85a-4ad6-81b4-118ac9c9d4e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:07.806171 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d59d6089-d85a-4ad6-81b4-118ac9c9d4e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:07.806860 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d59d6089-d85a-4ad6-81b4-118ac9c9d4e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:07.807305 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d59d6089-d85a-4ad6-81b4-118ac9c9d4e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:07.807784 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d59d6089-d85a-4ad6-81b4-118ac9c9d4e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:07.944905 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-d59d6089-d85a-4ad6-81b4-118ac9c9d4e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:07.954170 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-d59d6089-d85a-4ad6-81b4-118ac9c9d4e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:07.955694 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-d59d6089-d85a-4ad6-81b4-118ac9c9d4e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:07.956857 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-d59d6089-d85a-4ad6-81b4-118ac9c9d4e0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.162150 Aug 22 05:44:07.957376 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 325/635] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:07 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:08.819560 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-dc612299-9fe7-4c80-8809-a2eb583a3118 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:08.820590 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-dc612299-9fe7-4c80-8809-a2eb583a3118 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:08.825234 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6a0ac893-3f11-41b4-95b5-964719bffce5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:08.827002 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-6a0ac893-3f11-41b4-95b5-964719bffce5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:08.831650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dc612299-9fe7-4c80-8809-a2eb583a3118 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:08.832320 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dc612299-9fe7-4c80-8809-a2eb583a3118 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:08.833039 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dc612299-9fe7-4c80-8809-a2eb583a3118 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:08.834047 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dc612299-9fe7-4c80-8809-a2eb583a3118 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:08.834716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dc612299-9fe7-4c80-8809-a2eb583a3118 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:08.835338 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dc612299-9fe7-4c80-8809-a2eb583a3118 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:08.837157 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a0ac893-3f11-41b4-95b5-964719bffce5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:08.837868 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a0ac893-3f11-41b4-95b5-964719bffce5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:08.838855 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a0ac893-3f11-41b4-95b5-964719bffce5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:08.839948 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a0ac893-3f11-41b4-95b5-964719bffce5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:08.841054 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a0ac893-3f11-41b4-95b5-964719bffce5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:08.841691 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6a0ac893-3f11-41b4-95b5-964719bffce5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:09.030221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-dc612299-9fe7-4c80-8809-a2eb583a3118 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:09.035031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6a0ac893-3f11-41b4-95b5-964719bffce5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:09.041943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-dc612299-9fe7-4c80-8809-a2eb583a3118 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.228980 Aug 22 05:44:09.042722 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 311/636] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:08 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:09.045566 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6a0ac893-3f11-41b4-95b5-964719bffce5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.226443 Aug 22 05:44:09.050550 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 326/637] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:08 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:09.050717 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d7a29cd5-a0df-4f9b-a0fb-742f633ad862 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:09.050717 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d7a29cd5-a0df-4f9b-a0fb-742f633ad862 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:09.054572 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7a29cd5-a0df-4f9b-a0fb-742f633ad862 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:09.055063 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7a29cd5-a0df-4f9b-a0fb-742f633ad862 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:09.055496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7a29cd5-a0df-4f9b-a0fb-742f633ad862 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:09.056246 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7a29cd5-a0df-4f9b-a0fb-742f633ad862 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:09.056696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7a29cd5-a0df-4f9b-a0fb-742f633ad862 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:09.057121 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7a29cd5-a0df-4f9b-a0fb-742f633ad862 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:09.185664 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d7a29cd5-a0df-4f9b-a0fb-742f633ad862 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:09.194848 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d7a29cd5-a0df-4f9b-a0fb-742f633ad862 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:09.196373 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d7a29cd5-a0df-4f9b-a0fb-742f633ad862 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:09.197534 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d7a29cd5-a0df-4f9b-a0fb-742f633ad862 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.153739 Aug 22 05:44:09.198086 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 312/638] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:09 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:10.068897 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-10392f2d-9e66-40f5-a9d2-996dd1a0cc1e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:10.069837 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-10392f2d-9e66-40f5-a9d2-996dd1a0cc1e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:10.070442 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3a4fb516-2e37-4774-8087-0243792f8938 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:10.071545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3a4fb516-2e37-4774-8087-0243792f8938 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:10.080963 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-10392f2d-9e66-40f5-a9d2-996dd1a0cc1e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:10.081716 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-10392f2d-9e66-40f5-a9d2-996dd1a0cc1e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:10.082451 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-10392f2d-9e66-40f5-a9d2-996dd1a0cc1e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:10.082708 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a4fb516-2e37-4774-8087-0243792f8938 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:10.083267 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a4fb516-2e37-4774-8087-0243792f8938 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:10.083504 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-10392f2d-9e66-40f5-a9d2-996dd1a0cc1e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:10.084056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a4fb516-2e37-4774-8087-0243792f8938 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:10.084445 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-10392f2d-9e66-40f5-a9d2-996dd1a0cc1e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:10.085014 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-10392f2d-9e66-40f5-a9d2-996dd1a0cc1e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:10.085266 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a4fb516-2e37-4774-8087-0243792f8938 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:10.085880 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a4fb516-2e37-4774-8087-0243792f8938 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:10.086604 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a4fb516-2e37-4774-8087-0243792f8938 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:10.301385 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3a4fb516-2e37-4774-8087-0243792f8938 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:10.309616 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3a4fb516-2e37-4774-8087-0243792f8938 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.245521 Aug 22 05:44:10.310806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 313/639] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:10 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:10.313925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-10392f2d-9e66-40f5-a9d2-996dd1a0cc1e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:10.316144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f5ec27b5-bfed-4418-9a69-e972fe2f3632 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:10.316910 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f5ec27b5-bfed-4418-9a69-e972fe2f3632 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:10.322846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5ec27b5-bfed-4418-9a69-e972fe2f3632 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:10.323316 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5ec27b5-bfed-4418-9a69-e972fe2f3632 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:10.323780 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5ec27b5-bfed-4418-9a69-e972fe2f3632 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:10.324449 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5ec27b5-bfed-4418-9a69-e972fe2f3632 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:10.324887 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5ec27b5-bfed-4418-9a69-e972fe2f3632 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:10.325294 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5ec27b5-bfed-4418-9a69-e972fe2f3632 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:10.329636 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-10392f2d-9e66-40f5-a9d2-996dd1a0cc1e tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.267752 Aug 22 05:44:10.330217 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 327/640] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:10 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:10.464288 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f5ec27b5-bfed-4418-9a69-e972fe2f3632 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:10.478366 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f5ec27b5-bfed-4418-9a69-e972fe2f3632 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:10.480954 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f5ec27b5-bfed-4418-9a69-e972fe2f3632 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:10.482691 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f5ec27b5-bfed-4418-9a69-e972fe2f3632 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.170110 Aug 22 05:44:10.483538 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 314/641] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:10 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:11.335122 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4914a36c-f243-4533-91f4-93529f9729a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:11.336079 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4914a36c-f243-4533-91f4-93529f9729a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:11.347913 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4914a36c-f243-4533-91f4-93529f9729a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:11.348713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4914a36c-f243-4533-91f4-93529f9729a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:11.349411 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4914a36c-f243-4533-91f4-93529f9729a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:11.350533 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4914a36c-f243-4533-91f4-93529f9729a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:11.351265 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4914a36c-f243-4533-91f4-93529f9729a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:11.352004 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4914a36c-f243-4533-91f4-93529f9729a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:11.354006 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7f53d5f8-c8ea-42fe-8015-c2135ee91e03 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:11.354966 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7f53d5f8-c8ea-42fe-8015-c2135ee91e03 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:11.363088 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f53d5f8-c8ea-42fe-8015-c2135ee91e03 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:11.363599 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f53d5f8-c8ea-42fe-8015-c2135ee91e03 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:11.364028 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f53d5f8-c8ea-42fe-8015-c2135ee91e03 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:11.364713 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f53d5f8-c8ea-42fe-8015-c2135ee91e03 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:11.365163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f53d5f8-c8ea-42fe-8015-c2135ee91e03 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:11.365581 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f53d5f8-c8ea-42fe-8015-c2135ee91e03 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:11.546445 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4914a36c-f243-4533-91f4-93529f9729a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:11.551264 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7f53d5f8-c8ea-42fe-8015-c2135ee91e03 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:11.555600 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4914a36c-f243-4533-91f4-93529f9729a1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.226904 Aug 22 05:44:11.556212 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 328/642] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:11 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:11.560291 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7f53d5f8-c8ea-42fe-8015-c2135ee91e03 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.212515 Aug 22 05:44:11.561173 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 315/643] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:11 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:11.564016 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-606359a1-9ef5-48c1-b7c5-cc48282a2b90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:11.564817 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-606359a1-9ef5-48c1-b7c5-cc48282a2b90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:11.573162 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-606359a1-9ef5-48c1-b7c5-cc48282a2b90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:11.573635 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-606359a1-9ef5-48c1-b7c5-cc48282a2b90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:11.574055 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-606359a1-9ef5-48c1-b7c5-cc48282a2b90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:11.574739 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-606359a1-9ef5-48c1-b7c5-cc48282a2b90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:11.575182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-606359a1-9ef5-48c1-b7c5-cc48282a2b90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:11.575621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-606359a1-9ef5-48c1-b7c5-cc48282a2b90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:11.727202 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-606359a1-9ef5-48c1-b7c5-cc48282a2b90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:11.736594 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-606359a1-9ef5-48c1-b7c5-cc48282a2b90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:11.738089 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-606359a1-9ef5-48c1-b7c5-cc48282a2b90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:11.739242 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-606359a1-9ef5-48c1-b7c5-cc48282a2b90 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.181914 Aug 22 05:44:11.739807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 329/644] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:11 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:12.580073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-73fb89ec-8851-44b0-9286-c9a4ca50540d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:12.580918 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-73fb89ec-8851-44b0-9286-c9a4ca50540d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:12.582775 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:12.583328 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-be742838-73b5-4b39-8434-2f14426807bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:12.584020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-be742838-73b5-4b39-8434-2f14426807bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:12.589127 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73fb89ec-8851-44b0-9286-c9a4ca50540d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:12.589614 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73fb89ec-8851-44b0-9286-c9a4ca50540d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:12.590039 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73fb89ec-8851-44b0-9286-c9a4ca50540d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:12.590729 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-be742838-73b5-4b39-8434-2f14426807bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:12.591089 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73fb89ec-8851-44b0-9286-c9a4ca50540d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:12.591246 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-be742838-73b5-4b39-8434-2f14426807bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:12.591530 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73fb89ec-8851-44b0-9286-c9a4ca50540d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:12.591708 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-be742838-73b5-4b39-8434-2f14426807bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:12.591980 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73fb89ec-8851-44b0-9286-c9a4ca50540d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:12.592339 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-be742838-73b5-4b39-8434-2f14426807bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:12.592787 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-be742838-73b5-4b39-8434-2f14426807bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:12.593391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-be742838-73b5-4b39-8434-2f14426807bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:12.791692 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-be742838-73b5-4b39-8434-2f14426807bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:12.795871 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-73fb89ec-8851-44b0-9286-c9a4ca50540d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:12.800929 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-be742838-73b5-4b39-8434-2f14426807bc tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.222206 Aug 22 05:44:12.801548 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 330/645] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:12 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:12.804548 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-73fb89ec-8851-44b0-9286-c9a4ca50540d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.229603 Aug 22 05:44:12.805389 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 316/646] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:12 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:12.806173 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ad4834c2-3825-4f65-8a80-a9c59eb18de1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:12.806979 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ad4834c2-3825-4f65-8a80-a9c59eb18de1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:12.813357 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ad4834c2-3825-4f65-8a80-a9c59eb18de1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:12.813839 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ad4834c2-3825-4f65-8a80-a9c59eb18de1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:12.814268 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ad4834c2-3825-4f65-8a80-a9c59eb18de1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:12.814954 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ad4834c2-3825-4f65-8a80-a9c59eb18de1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:12.815402 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ad4834c2-3825-4f65-8a80-a9c59eb18de1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:12.815860 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ad4834c2-3825-4f65-8a80-a9c59eb18de1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:12.955837 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ad4834c2-3825-4f65-8a80-a9c59eb18de1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:12.969123 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ad4834c2-3825-4f65-8a80-a9c59eb18de1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:12.970925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ad4834c2-3825-4f65-8a80-a9c59eb18de1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:12.972188 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ad4834c2-3825-4f65-8a80-a9c59eb18de1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.169711 Aug 22 05:44:12.972752 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 331/647] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:12 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:13.825640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1836c0a1-3865-4595-b141-cee925166dc9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:13.826515 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1836c0a1-3865-4595-b141-cee925166dc9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:13.829590 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0dba0196-b8a2-4a84-92af-50005a210c91 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:13.830597 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0dba0196-b8a2-4a84-92af-50005a210c91 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:13.834254 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=64 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:13.837465 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1836c0a1-3865-4595-b141-cee925166dc9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:13.838405 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1836c0a1-3865-4595-b141-cee925166dc9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:13.839062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1836c0a1-3865-4595-b141-cee925166dc9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:13.841022 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1836c0a1-3865-4595-b141-cee925166dc9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:13.841772 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1836c0a1-3865-4595-b141-cee925166dc9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:13.842464 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1836c0a1-3865-4595-b141-cee925166dc9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:13.842847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0dba0196-b8a2-4a84-92af-50005a210c91 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:13.843679 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0dba0196-b8a2-4a84-92af-50005a210c91 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:13.844461 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0dba0196-b8a2-4a84-92af-50005a210c91 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:13.845189 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0dba0196-b8a2-4a84-92af-50005a210c91 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:13.845727 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0dba0196-b8a2-4a84-92af-50005a210c91 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:13.846113 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0dba0196-b8a2-4a84-92af-50005a210c91 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:13.850643 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=100 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:14.038440 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1836c0a1-3865-4595-b141-cee925166dc9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:14.043065 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0dba0196-b8a2-4a84-92af-50005a210c91 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:14.050529 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1836c0a1-3865-4595-b141-cee925166dc9 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1736 microversion: 2.1 time: 0.231405 Aug 22 05:44:14.051207 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 317/648] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:13 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:14.054445 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0dba0196-b8a2-4a84-92af-50005a210c91 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.231515 Aug 22 05:44:14.055275 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 332/649] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:13 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:14.061139 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-967bbaa7-8ecf-4432-9376-4c36481be610 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:14.062227 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-967bbaa7-8ecf-4432-9376-4c36481be610 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:14.069001 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-967bbaa7-8ecf-4432-9376-4c36481be610 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:14.069480 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-967bbaa7-8ecf-4432-9376-4c36481be610 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:14.069905 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-967bbaa7-8ecf-4432-9376-4c36481be610 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:14.070587 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-967bbaa7-8ecf-4432-9376-4c36481be610 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:14.071029 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-967bbaa7-8ecf-4432-9376-4c36481be610 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:14.071440 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-967bbaa7-8ecf-4432-9376-4c36481be610 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:14.205703 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-967bbaa7-8ecf-4432-9376-4c36481be610 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:14.214606 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-967bbaa7-8ecf-4432-9376-4c36481be610 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:14.216488 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-967bbaa7-8ecf-4432-9376-4c36481be610 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:14.217634 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-967bbaa7-8ecf-4432-9376-4c36481be610 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.164969 Aug 22 05:44:14.218165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 318/650] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:14 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:15.076705 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b74e5ae0-e990-4ecd-88dd-08d1f32433df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:15.077277 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b74e5ae0-e990-4ecd-88dd-08d1f32433df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:15.078271 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-af7c1ceb-5a82-4d18-953f-0003ad1a411b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:15.078912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-af7c1ceb-5a82-4d18-953f-0003ad1a411b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:15.083965 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b74e5ae0-e990-4ecd-88dd-08d1f32433df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:15.084448 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b74e5ae0-e990-4ecd-88dd-08d1f32433df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:15.084883 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b74e5ae0-e990-4ecd-88dd-08d1f32433df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:15.085554 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b74e5ae0-e990-4ecd-88dd-08d1f32433df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:15.085923 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af7c1ceb-5a82-4d18-953f-0003ad1a411b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:15.086094 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b74e5ae0-e990-4ecd-88dd-08d1f32433df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:15.086415 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af7c1ceb-5a82-4d18-953f-0003ad1a411b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:15.086577 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b74e5ae0-e990-4ecd-88dd-08d1f32433df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:15.086835 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af7c1ceb-5a82-4d18-953f-0003ad1a411b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:15.087533 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af7c1ceb-5a82-4d18-953f-0003ad1a411b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:15.088018 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af7c1ceb-5a82-4d18-953f-0003ad1a411b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:15.088444 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af7c1ceb-5a82-4d18-953f-0003ad1a411b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:15.279220 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b74e5ae0-e990-4ecd-88dd-08d1f32433df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:15.283384 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-af7c1ceb-5a82-4d18-953f-0003ad1a411b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:15.288190 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b74e5ae0-e990-4ecd-88dd-08d1f32433df tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1716 microversion: 2.1 time: 0.215563 Aug 22 05:44:15.288918 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 333/651] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:15 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1716 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:15.291272 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-af7c1ceb-5a82-4d18-953f-0003ad1a411b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.216942 Aug 22 05:44:15.291898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 319/652] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:15 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:15.300598 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-48fc528f-6f2d-46fb-b80a-5f2e443802f8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:15.301207 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-48fc528f-6f2d-46fb-b80a-5f2e443802f8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:15.307337 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-48fc528f-6f2d-46fb-b80a-5f2e443802f8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:15.307847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-48fc528f-6f2d-46fb-b80a-5f2e443802f8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:15.308278 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-48fc528f-6f2d-46fb-b80a-5f2e443802f8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:15.308999 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-48fc528f-6f2d-46fb-b80a-5f2e443802f8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:15.309449 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-48fc528f-6f2d-46fb-b80a-5f2e443802f8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:15.309866 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-48fc528f-6f2d-46fb-b80a-5f2e443802f8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:15.351159 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-176bbbce-8565-4e55-8be1-4643b8cb291f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:15.351648 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-176bbbce-8565-4e55-8be1-4643b8cb291f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:15.357771 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-176bbbce-8565-4e55-8be1-4643b8cb291f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:15.358289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-176bbbce-8565-4e55-8be1-4643b8cb291f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:15.358724 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-176bbbce-8565-4e55-8be1-4643b8cb291f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:15.359415 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-176bbbce-8565-4e55-8be1-4643b8cb291f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:15.359904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-176bbbce-8565-4e55-8be1-4643b8cb291f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:15.360321 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-176bbbce-8565-4e55-8be1-4643b8cb291f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:15.448146 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-176bbbce-8565-4e55-8be1-4643b8cb291f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] HTTP exception thrown: Cannot 'detach_volume' instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 while it is in vm_state rescued Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-176bbbce-8565-4e55-8be1-4643b8cb291f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Request method failure captured: Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: DELETE /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/os-volume_attachments/4953c424-ce7d-4eca-818c-6c54c5a591ec HTTP/1.1 Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxZJ7BdnzK-u4DKWWTr2FX2u5pwmnE2XjOu8umL3m5FZVx9vs8-L9guf58r47bG_oFQDAwD733BJkilMph8nunSZNTzBoLdMj0DH2XIL-y0pAdClU7WOEjgndU2mtYSxv2QT6l_KuebCiUPUyx_PUd635STXp1Lia-VSwvM8EBbSje4 Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 8cadb48afce14e758bfe62771530527a Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1818501039 Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:44:15.449788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:44:15.451413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8cadb48afce14e758bfe62771530527a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cadb48afce14e758bfe62771530527a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cadb48afce14e758bfe62771530527a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8cadb48afce14e758bfe62771530527a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:44:15.451413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1818501039 Aug 22 05:44:15.451413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 8cadb48afce14e758bfe62771530527a Aug 22 05:44:15.451413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1818501039 Aug 22 05:44:15.451413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-ServerRescueNegativeTestJSON-1818501039-project Aug 22 05:44:15.451413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:44:15.451413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:44:15.451413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 9643b0f10e8345889c181efbb1978237 Aug 22 05:44:15.451413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1818501039-project Aug 22 05:44:15.451413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:44:15.451413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Cannot 'detach_volume' instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 while it is in vm_state rescued Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'server_id': '38c93cef-e688-4d2c-ad3d-508c12c362f3', 'id': '4953c424-ce7d-4eca-818c-6c54c5a591ec'} Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:44:15.452297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:44:15.453792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 22 05:44:15.453792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 22 05:44:15.453792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 22 05:44:15.453792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 22 05:44:15.453792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 while it is in vm_state rescued Aug 22 05:44:15.453792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:44:15.453792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:44:15.453792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:44:15.453792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:44:15.453792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:44:15.453792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:44:15.453792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:44:15.453792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:44:15.453792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 while it is in vm_state rescued Aug 22 05:44:15.453792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:44:15.453792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-176bbbce-8565-4e55-8be1-4643b8cb291f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Returning 409 to user: Cannot 'detach_volume' instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 while it is in vm_state rescued {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:44:15.454982 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-176bbbce-8565-4e55-8be1-4643b8cb291f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "DELETE /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/os-volume_attachments/4953c424-ce7d-4eca-818c-6c54c5a591ec" status: 409 len: 152 microversion: 2.1 time: 0.104244 Aug 22 05:44:15.454982 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 320/653] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 22 05:44:15 2022] DELETE /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/os-volume_attachments/4953c424-ce7d-4eca-818c-6c54c5a591ec => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 22 05:44:15.459258 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-48fc528f-6f2d-46fb-b80a-5f2e443802f8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:15.463485 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-728e59b5-3a54-4e3c-8b92-cc45ac6ed640 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:44:15.464124 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-728e59b5-3a54-4e3c-8b92-cc45ac6ed640 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:15.468620 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-48fc528f-6f2d-46fb-b80a-5f2e443802f8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:15.470210 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-48fc528f-6f2d-46fb-b80a-5f2e443802f8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:15.470936 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-728e59b5-3a54-4e3c-8b92-cc45ac6ed640 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:15.471358 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-48fc528f-6f2d-46fb-b80a-5f2e443802f8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.174887 Aug 22 05:44:15.471474 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-728e59b5-3a54-4e3c-8b92-cc45ac6ed640 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:15.471942 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 334/654] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:15 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:15.472063 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-728e59b5-3a54-4e3c-8b92-cc45ac6ed640 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:15.472764 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-728e59b5-3a54-4e3c-8b92-cc45ac6ed640 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:15.473221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-728e59b5-3a54-4e3c-8b92-cc45ac6ed640 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:15.473640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-728e59b5-3a54-4e3c-8b92-cc45ac6ed640 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:15.543959 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-728e59b5-3a54-4e3c-8b92-cc45ac6ed640 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "POST /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/action" status: 202 len: 0 microversion: 2.1 time: 0.084059 Aug 22 05:44:15.547841 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 321/655] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 22 05:44:15 2022] POST /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 05:44:15.554019 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7a5a8e42-4e64-4975-9b7f-97d161bc5701 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:15.554623 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-7a5a8e42-4e64-4975-9b7f-97d161bc5701 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:15.561487 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7a5a8e42-4e64-4975-9b7f-97d161bc5701 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:15.561988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7a5a8e42-4e64-4975-9b7f-97d161bc5701 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:15.562382 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7a5a8e42-4e64-4975-9b7f-97d161bc5701 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:15.563117 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7a5a8e42-4e64-4975-9b7f-97d161bc5701 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:15.563595 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7a5a8e42-4e64-4975-9b7f-97d161bc5701 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:15.564055 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7a5a8e42-4e64-4975-9b7f-97d161bc5701 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:15.783609 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-7a5a8e42-4e64-4975-9b7f-97d161bc5701 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:15.793196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-7a5a8e42-4e64-4975-9b7f-97d161bc5701 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1724 microversion: 2.1 time: 0.242982 Aug 22 05:44:15.793683 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 335/656] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:15 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:16.318856 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-777b8cf3-662c-4841-b42b-49080f044c51 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:16.320004 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-777b8cf3-662c-4841-b42b-49080f044c51 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:16.331350 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-777b8cf3-662c-4841-b42b-49080f044c51 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:16.331864 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-777b8cf3-662c-4841-b42b-49080f044c51 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:16.332300 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-777b8cf3-662c-4841-b42b-49080f044c51 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:16.332986 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-777b8cf3-662c-4841-b42b-49080f044c51 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:16.333436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-777b8cf3-662c-4841-b42b-49080f044c51 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:16.333848 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-777b8cf3-662c-4841-b42b-49080f044c51 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:16.483530 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-777b8cf3-662c-4841-b42b-49080f044c51 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:16.491642 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-777b8cf3-662c-4841-b42b-49080f044c51 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.181355 Aug 22 05:44:16.492248 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 322/657] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:16 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:16.494645 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4fb3f8b9-6c4d-4dc0-a4b5-bde19c334a7b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:16.495254 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4fb3f8b9-6c4d-4dc0-a4b5-bde19c334a7b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:16.502273 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fb3f8b9-6c4d-4dc0-a4b5-bde19c334a7b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:16.502794 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fb3f8b9-6c4d-4dc0-a4b5-bde19c334a7b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:16.503295 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fb3f8b9-6c4d-4dc0-a4b5-bde19c334a7b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:16.504231 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fb3f8b9-6c4d-4dc0-a4b5-bde19c334a7b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:16.505010 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fb3f8b9-6c4d-4dc0-a4b5-bde19c334a7b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:16.505759 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4fb3f8b9-6c4d-4dc0-a4b5-bde19c334a7b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:16.645168 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4fb3f8b9-6c4d-4dc0-a4b5-bde19c334a7b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:16.659136 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4fb3f8b9-6c4d-4dc0-a4b5-bde19c334a7b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:16.661667 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4fb3f8b9-6c4d-4dc0-a4b5-bde19c334a7b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:16.663476 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4fb3f8b9-6c4d-4dc0-a4b5-bde19c334a7b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.172441 Aug 22 05:44:16.664429 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 336/658] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:16 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:16.815136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-83743bf4-c7bb-4cc2-bbd7-f72f93100460 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:16.815919 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-83743bf4-c7bb-4cc2-bbd7-f72f93100460 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:16.822020 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83743bf4-c7bb-4cc2-bbd7-f72f93100460 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:16.822890 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83743bf4-c7bb-4cc2-bbd7-f72f93100460 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:16.823000 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83743bf4-c7bb-4cc2-bbd7-f72f93100460 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:16.823948 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83743bf4-c7bb-4cc2-bbd7-f72f93100460 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:16.824487 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83743bf4-c7bb-4cc2-bbd7-f72f93100460 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:16.825189 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-83743bf4-c7bb-4cc2-bbd7-f72f93100460 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:16.963999 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-83743bf4-c7bb-4cc2-bbd7-f72f93100460 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:16.970612 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-5c42a1b1-3e0e-4888-8b0d-8ec86afb2595 req-0d8ea031-1a35-4b7b-a7be-b1ae6fc77f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb", "name": "network-vif-plugged", "status": "completed", "tag": "4c76faf8-d367-4a1e-9d06-cc6e666badde"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:44:16.973120 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-83743bf4-c7bb-4cc2-bbd7-f72f93100460 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1724 microversion: 2.1 time: 0.162031 Aug 22 05:44:16.973789 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 323/659] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:16 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:16.980436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-5c42a1b1-3e0e-4888-8b0d-8ec86afb2595 req-0d8ea031-1a35-4b7b-a7be-b1ae6fc77f58 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:16.980900 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-5c42a1b1-3e0e-4888-8b0d-8ec86afb2595 req-0d8ea031-1a35-4b7b-a7be-b1ae6fc77f58 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:16.981325 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-5c42a1b1-3e0e-4888-8b0d-8ec86afb2595 req-0d8ea031-1a35-4b7b-a7be-b1ae6fc77f58 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:16.992538 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-5c42a1b1-3e0e-4888-8b0d-8ec86afb2595 req-0d8ea031-1a35-4b7b-a7be-b1ae6fc77f58 service nova] Creating event network-vif-plugged:4c76faf8-d367-4a1e-9d06-cc6e666badde for instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb on hv-cinder-85391 Aug 22 05:44:16.997417 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-5c42a1b1-3e0e-4888-8b0d-8ec86afb2595 req-0d8ea031-1a35-4b7b-a7be-b1ae6fc77f58 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113557 Aug 22 05:44:16.998023 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 337/660] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:44:17.518532 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-76fb615c-987e-482f-a61b-9a8b1a6d6f52 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:17.519495 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-76fb615c-987e-482f-a61b-9a8b1a6d6f52 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:17.530259 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-76fb615c-987e-482f-a61b-9a8b1a6d6f52 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:17.531052 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-76fb615c-987e-482f-a61b-9a8b1a6d6f52 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:17.531816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-76fb615c-987e-482f-a61b-9a8b1a6d6f52 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:17.532745 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-76fb615c-987e-482f-a61b-9a8b1a6d6f52 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:17.533187 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-76fb615c-987e-482f-a61b-9a8b1a6d6f52 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:17.533602 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-76fb615c-987e-482f-a61b-9a8b1a6d6f52 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:17.676506 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-76fb615c-987e-482f-a61b-9a8b1a6d6f52 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:17.685028 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-76fb615c-987e-482f-a61b-9a8b1a6d6f52 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.173158 Aug 22 05:44:17.685646 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 324/661] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:17 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:17.693346 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-79d785bb-5d3f-4369-b9b0-1ef3a6a038ad tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:17.694137 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-79d785bb-5d3f-4369-b9b0-1ef3a6a038ad tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:17.700732 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-79d785bb-5d3f-4369-b9b0-1ef3a6a038ad tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:17.701212 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-79d785bb-5d3f-4369-b9b0-1ef3a6a038ad tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:17.701646 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-79d785bb-5d3f-4369-b9b0-1ef3a6a038ad tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:17.702328 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-79d785bb-5d3f-4369-b9b0-1ef3a6a038ad tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:17.702781 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-79d785bb-5d3f-4369-b9b0-1ef3a6a038ad tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:17.703204 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-79d785bb-5d3f-4369-b9b0-1ef3a6a038ad tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:17.842499 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-79d785bb-5d3f-4369-b9b0-1ef3a6a038ad tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:17.851687 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-79d785bb-5d3f-4369-b9b0-1ef3a6a038ad tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:17.853179 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-79d785bb-5d3f-4369-b9b0-1ef3a6a038ad tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:17.854339 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-79d785bb-5d3f-4369-b9b0-1ef3a6a038ad tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.166970 Aug 22 05:44:17.854900 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 338/662] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:17 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:17.996113 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-af27d910-f287-4068-aba3-337901e0b1ea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:17.996824 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-af27d910-f287-4068-aba3-337901e0b1ea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:18.004388 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af27d910-f287-4068-aba3-337901e0b1ea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:18.004953 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af27d910-f287-4068-aba3-337901e0b1ea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:18.005448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af27d910-f287-4068-aba3-337901e0b1ea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:18.006276 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af27d910-f287-4068-aba3-337901e0b1ea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:18.006801 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af27d910-f287-4068-aba3-337901e0b1ea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:18.007297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af27d910-f287-4068-aba3-337901e0b1ea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:18.171632 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-af27d910-f287-4068-aba3-337901e0b1ea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:18.180687 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-af27d910-f287-4068-aba3-337901e0b1ea tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1724 microversion: 2.1 time: 0.189167 Aug 22 05:44:18.181273 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 325/663] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:17 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:18.707490 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ae935653-9c00-4f68-85f0-545754ac9525 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:18.708359 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ae935653-9c00-4f68-85f0-545754ac9525 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:18.715564 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ae935653-9c00-4f68-85f0-545754ac9525 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:18.716079 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ae935653-9c00-4f68-85f0-545754ac9525 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:18.717151 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ae935653-9c00-4f68-85f0-545754ac9525 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:18.718213 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ae935653-9c00-4f68-85f0-545754ac9525 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:18.718664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ae935653-9c00-4f68-85f0-545754ac9525 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:18.719260 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ae935653-9c00-4f68-85f0-545754ac9525 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:18.858811 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ae935653-9c00-4f68-85f0-545754ac9525 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:18.867841 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ae935653-9c00-4f68-85f0-545754ac9525 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.165179 Aug 22 05:44:18.868447 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 339/664] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:18 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:18.877598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1db6b8f4-def1-4a46-9b92-767c781437fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:18.878270 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1db6b8f4-def1-4a46-9b92-767c781437fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:18.885075 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1db6b8f4-def1-4a46-9b92-767c781437fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:18.885554 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1db6b8f4-def1-4a46-9b92-767c781437fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:18.885977 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1db6b8f4-def1-4a46-9b92-767c781437fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:18.886624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1db6b8f4-def1-4a46-9b92-767c781437fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:18.887063 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1db6b8f4-def1-4a46-9b92-767c781437fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:18.887473 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1db6b8f4-def1-4a46-9b92-767c781437fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:18.903440 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:19.019945 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1db6b8f4-def1-4a46-9b92-767c781437fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:19.029030 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1db6b8f4-def1-4a46-9b92-767c781437fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:19.030513 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1db6b8f4-def1-4a46-9b92-767c781437fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:19.031677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1db6b8f4-def1-4a46-9b92-767c781437fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.157970 Aug 22 05:44:19.032237 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 326/665] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:18 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:19.202431 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-62dfde58-8f87-4670-917f-ee27fa70829f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:19.203025 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-62dfde58-8f87-4670-917f-ee27fa70829f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:19.209593 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-62dfde58-8f87-4670-917f-ee27fa70829f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:19.210082 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-62dfde58-8f87-4670-917f-ee27fa70829f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:19.210514 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-62dfde58-8f87-4670-917f-ee27fa70829f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:19.211211 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-62dfde58-8f87-4670-917f-ee27fa70829f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:19.211696 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-62dfde58-8f87-4670-917f-ee27fa70829f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:19.212090 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-62dfde58-8f87-4670-917f-ee27fa70829f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:19.349061 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-62dfde58-8f87-4670-917f-ee27fa70829f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:19.357617 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-62dfde58-8f87-4670-917f-ee27fa70829f tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1730 microversion: 2.1 time: 0.159220 Aug 22 05:44:19.358168 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 340/666] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:19 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:19.380841 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7d944227-63f9-447b-b170-5fd1c3063b7b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:19.381576 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7d944227-63f9-447b-b170-5fd1c3063b7b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:19.391206 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7d944227-63f9-447b-b170-5fd1c3063b7b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:19.392016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7d944227-63f9-447b-b170-5fd1c3063b7b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:19.392612 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7d944227-63f9-447b-b170-5fd1c3063b7b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:19.393603 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7d944227-63f9-447b-b170-5fd1c3063b7b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:19.394158 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7d944227-63f9-447b-b170-5fd1c3063b7b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:19.394649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7d944227-63f9-447b-b170-5fd1c3063b7b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:19.486790 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7d944227-63f9-447b-b170-5fd1c3063b7b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111985 Aug 22 05:44:19.487364 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 327/667] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Aug 22 05:44:19 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:44:19.890176 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e6b3a550-8f4d-4448-9f15-9084542b6c32 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:19.890820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e6b3a550-8f4d-4448-9f15-9084542b6c32 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:19.898089 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e6b3a550-8f4d-4448-9f15-9084542b6c32 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:19.898716 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e6b3a550-8f4d-4448-9f15-9084542b6c32 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:19.899244 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e6b3a550-8f4d-4448-9f15-9084542b6c32 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:19.900080 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e6b3a550-8f4d-4448-9f15-9084542b6c32 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:19.900655 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e6b3a550-8f4d-4448-9f15-9084542b6c32 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:19.901360 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e6b3a550-8f4d-4448-9f15-9084542b6c32 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:20.054933 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-499c799b-feb1-422c-bcca-93c5302cffa0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:20.055620 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-499c799b-feb1-422c-bcca-93c5302cffa0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:20.062356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-499c799b-feb1-422c-bcca-93c5302cffa0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:20.062842 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-499c799b-feb1-422c-bcca-93c5302cffa0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:20.063298 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-499c799b-feb1-422c-bcca-93c5302cffa0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:20.064029 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-499c799b-feb1-422c-bcca-93c5302cffa0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:20.064471 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-499c799b-feb1-422c-bcca-93c5302cffa0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:20.064886 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-499c799b-feb1-422c-bcca-93c5302cffa0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:20.393897 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e6b3a550-8f4d-4448-9f15-9084542b6c32 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:20.399166 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-499c799b-feb1-422c-bcca-93c5302cffa0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:20.402058 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e6b3a550-8f4d-4448-9f15-9084542b6c32 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.515881 Aug 22 05:44:20.403201 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 341/668] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:19 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:20.410728 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-499c799b-feb1-422c-bcca-93c5302cffa0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:20.412958 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-499c799b-feb1-422c-bcca-93c5302cffa0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:20.414681 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-499c799b-feb1-422c-bcca-93c5302cffa0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1807 microversion: 2.20 time: 0.364042 Aug 22 05:44:20.427620 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 328/669] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:20 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1807 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:44:20.871896 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-1455e061-66d4-420e-9cd8-c16ae9b968eb req-00a611d2-1f2c-48cf-9142-15d90a92803e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c93cef-e688-4d2c-ad3d-508c12c362f3", "tag": "fb44f91d-f5a9-4ec3-a7db-e4802e8c7620"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:44:20.882437 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-1455e061-66d4-420e-9cd8-c16ae9b968eb req-00a611d2-1f2c-48cf-9142-15d90a92803e service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:20.882878 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-1455e061-66d4-420e-9cd8-c16ae9b968eb req-00a611d2-1f2c-48cf-9142-15d90a92803e service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:20.883304 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-1455e061-66d4-420e-9cd8-c16ae9b968eb req-00a611d2-1f2c-48cf-9142-15d90a92803e service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:20.900734 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-1455e061-66d4-420e-9cd8-c16ae9b968eb req-00a611d2-1f2c-48cf-9142-15d90a92803e service nova] Creating event network-changed:fb44f91d-f5a9-4ec3-a7db-e4802e8c7620 for instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 on hv-cinder-85391 Aug 22 05:44:20.917447 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-1455e061-66d4-420e-9cd8-c16ae9b968eb req-00a611d2-1f2c-48cf-9142-15d90a92803e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127235 Aug 22 05:44:20.918124 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 342/670] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:44:21.424545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-33415426-152a-4a84-acb2-13ed1c33c5e1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:21.426069 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-33415426-152a-4a84-acb2-13ed1c33c5e1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:21.437544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33415426-152a-4a84-acb2-13ed1c33c5e1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:21.439023 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33415426-152a-4a84-acb2-13ed1c33c5e1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:21.439295 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-19add1d1-7895-4197-93a7-f2fccea587af tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:21.439656 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33415426-152a-4a84-acb2-13ed1c33c5e1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:21.440802 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33415426-152a-4a84-acb2-13ed1c33c5e1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:21.440905 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-19add1d1-7895-4197-93a7-f2fccea587af tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:21.440999 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33415426-152a-4a84-acb2-13ed1c33c5e1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:21.441481 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33415426-152a-4a84-acb2-13ed1c33c5e1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:21.448467 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19add1d1-7895-4197-93a7-f2fccea587af tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:21.450728 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19add1d1-7895-4197-93a7-f2fccea587af tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:21.451386 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19add1d1-7895-4197-93a7-f2fccea587af tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:21.452354 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19add1d1-7895-4197-93a7-f2fccea587af tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:21.453026 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19add1d1-7895-4197-93a7-f2fccea587af tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:21.453664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19add1d1-7895-4197-93a7-f2fccea587af tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:21.772745 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-33415426-152a-4a84-acb2-13ed1c33c5e1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:21.780023 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-19add1d1-7895-4197-93a7-f2fccea587af tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:21.781652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-33415426-152a-4a84-acb2-13ed1c33c5e1 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.361070 Aug 22 05:44:21.782640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 329/671] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:21 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:21.789406 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-19add1d1-7895-4197-93a7-f2fccea587af tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:21.790891 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-19add1d1-7895-4197-93a7-f2fccea587af tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:21.793131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-19add1d1-7895-4197-93a7-f2fccea587af tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1794 microversion: 2.20 time: 0.358351 Aug 22 05:44:21.800342 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 343/672] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:44:21 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1794 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 05:44:22.802988 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7c7ae079-082e-4f66-86ad-ee100b7af285 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:22.803600 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7c7ae079-082e-4f66-86ad-ee100b7af285 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:22.811109 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7c7ae079-082e-4f66-86ad-ee100b7af285 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:22.811606 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7c7ae079-082e-4f66-86ad-ee100b7af285 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:22.812117 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7c7ae079-082e-4f66-86ad-ee100b7af285 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:22.812849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7c7ae079-082e-4f66-86ad-ee100b7af285 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:22.813325 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7c7ae079-082e-4f66-86ad-ee100b7af285 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:22.813773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7c7ae079-082e-4f66-86ad-ee100b7af285 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:22.932833 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-d025765f-6dd7-4c91-8d5c-b360e017d328 req-9a5d26b2-fe4d-4208-a1a1-6a6cc0926d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c93cef-e688-4d2c-ad3d-508c12c362f3", "tag": "fb44f91d-f5a9-4ec3-a7db-e4802e8c7620"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:44:22.943207 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-d025765f-6dd7-4c91-8d5c-b360e017d328 req-9a5d26b2-fe4d-4208-a1a1-6a6cc0926d61 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:22.943714 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-d025765f-6dd7-4c91-8d5c-b360e017d328 req-9a5d26b2-fe4d-4208-a1a1-6a6cc0926d61 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:22.944125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-d025765f-6dd7-4c91-8d5c-b360e017d328 req-9a5d26b2-fe4d-4208-a1a1-6a6cc0926d61 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:22.956019 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-d025765f-6dd7-4c91-8d5c-b360e017d328 req-9a5d26b2-fe4d-4208-a1a1-6a6cc0926d61 service nova] Creating event network-changed:fb44f91d-f5a9-4ec3-a7db-e4802e8c7620 for instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 on hv-cinder-85391 Aug 22 05:44:22.957143 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7c7ae079-082e-4f66-86ad-ee100b7af285 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:22.961273 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-d025765f-6dd7-4c91-8d5c-b360e017d328 req-9a5d26b2-fe4d-4208-a1a1-6a6cc0926d61 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032084 Aug 22 05:44:22.962199 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 344/673] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:44:22.965650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7c7ae079-082e-4f66-86ad-ee100b7af285 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1676 microversion: 2.1 time: 0.166518 Aug 22 05:44:22.966222 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 330/674] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:22 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:23.993528 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-dc63b7bd-dac6-4799-be59-8c79a612cc89 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:23.994295 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-dc63b7bd-dac6-4799-be59-8c79a612cc89 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:24.001755 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc63b7bd-dac6-4799-be59-8c79a612cc89 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:24.002264 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc63b7bd-dac6-4799-be59-8c79a612cc89 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:24.002708 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc63b7bd-dac6-4799-be59-8c79a612cc89 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:24.003454 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc63b7bd-dac6-4799-be59-8c79a612cc89 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:24.004987 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc63b7bd-dac6-4799-be59-8c79a612cc89 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:24.005426 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc63b7bd-dac6-4799-be59-8c79a612cc89 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:24.145259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-dc63b7bd-dac6-4799-be59-8c79a612cc89 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:24.153169 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-dc63b7bd-dac6-4799-be59-8c79a612cc89 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1653 microversion: 2.1 time: 0.165479 Aug 22 05:44:24.153781 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 345/675] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:23 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1653 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:24.173933 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7cc46a35-159b-492d-8fb9-3754578bd4c9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:44:24.181299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7cc46a35-159b-492d-8fb9-3754578bd4c9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:24.181789 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7cc46a35-159b-492d-8fb9-3754578bd4c9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:24.182219 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7cc46a35-159b-492d-8fb9-3754578bd4c9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:24.205087 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7cc46a35-159b-492d-8fb9-3754578bd4c9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Going to try to start instance {{(pid=132498) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 22 05:44:24.252696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7cc46a35-159b-492d-8fb9-3754578bd4c9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "POST /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/action" status: 202 len: 0 microversion: 2.1 time: 0.082610 Aug 22 05:44:24.253296 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 331/676] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 22 05:44:24 2022] POST /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 05:44:24.261670 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0cd281ee-82ff-4c0e-9183-30f1d7d394db tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:24.262284 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0cd281ee-82ff-4c0e-9183-30f1d7d394db tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:24.268394 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0cd281ee-82ff-4c0e-9183-30f1d7d394db tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:24.268878 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0cd281ee-82ff-4c0e-9183-30f1d7d394db tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:24.269312 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0cd281ee-82ff-4c0e-9183-30f1d7d394db tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:24.270003 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0cd281ee-82ff-4c0e-9183-30f1d7d394db tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:24.270456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0cd281ee-82ff-4c0e-9183-30f1d7d394db tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:24.270874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0cd281ee-82ff-4c0e-9183-30f1d7d394db tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:24.416249 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0cd281ee-82ff-4c0e-9183-30f1d7d394db tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:24.424044 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0cd281ee-82ff-4c0e-9183-30f1d7d394db tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1662 microversion: 2.1 time: 0.166234 Aug 22 05:44:24.425118 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 346/677] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:24 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1662 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:25.447935 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fe8fa0ff-8992-4694-be82-488de6f195e0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:25.448590 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fe8fa0ff-8992-4694-be82-488de6f195e0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:25.455282 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe8fa0ff-8992-4694-be82-488de6f195e0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:25.455818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe8fa0ff-8992-4694-be82-488de6f195e0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:25.456236 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe8fa0ff-8992-4694-be82-488de6f195e0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:25.456914 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe8fa0ff-8992-4694-be82-488de6f195e0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:25.457354 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe8fa0ff-8992-4694-be82-488de6f195e0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:25.457764 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe8fa0ff-8992-4694-be82-488de6f195e0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:25.594165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fe8fa0ff-8992-4694-be82-488de6f195e0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:25.602621 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fe8fa0ff-8992-4694-be82-488de6f195e0 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1662 microversion: 2.1 time: 0.159843 Aug 22 05:44:25.603195 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 332/678] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:25 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1662 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:26.627862 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-bb9e69e9-0408-42cd-94c5-2cab8ad53397 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:26.628799 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-bb9e69e9-0408-42cd-94c5-2cab8ad53397 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:26.637257 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bb9e69e9-0408-42cd-94c5-2cab8ad53397 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:26.637764 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bb9e69e9-0408-42cd-94c5-2cab8ad53397 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:26.638192 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bb9e69e9-0408-42cd-94c5-2cab8ad53397 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:26.638884 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bb9e69e9-0408-42cd-94c5-2cab8ad53397 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:26.639333 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bb9e69e9-0408-42cd-94c5-2cab8ad53397 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:26.639797 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-bb9e69e9-0408-42cd-94c5-2cab8ad53397 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:26.785470 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-bb9e69e9-0408-42cd-94c5-2cab8ad53397 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:26.793673 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-bb9e69e9-0408-42cd-94c5-2cab8ad53397 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1666 microversion: 2.1 time: 0.172461 Aug 22 05:44:26.794244 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 347/679] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:26 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1666 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:27.328593 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 05:44:27.329415 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Mon Aug 22 05:44:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 05:44:57.397311 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5599c5ab-a9d9-4b03-a9c2-038b11c3787e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:44:57.398472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5599c5ab-a9d9-4b03-a9c2-038b11c3787e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:57.401650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=33 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:57.403650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:57.411996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5599c5ab-a9d9-4b03-a9c2-038b11c3787e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:57.412665 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5599c5ab-a9d9-4b03-a9c2-038b11c3787e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:57.413097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5599c5ab-a9d9-4b03-a9c2-038b11c3787e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:57.413812 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5599c5ab-a9d9-4b03-a9c2-038b11c3787e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:57.414410 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5599c5ab-a9d9-4b03-a9c2-038b11c3787e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:57.414949 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5599c5ab-a9d9-4b03-a9c2-038b11c3787e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:57.447368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-5599c5ab-a9d9-4b03-a9c2-038b11c3787e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lazy-loading 'flavor' on Instance uuid 57433a27-1ab9-4b19-b87b-fc2c80644b94 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:44:57.566009 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5599c5ab-a9d9-4b03-a9c2-038b11c3787e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "POST /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94/action" status: 202 len: 0 microversion: 2.1 time: 0.175448 Aug 22 05:44:57.566690 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 333/680] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 22 05:44:57 2022] POST /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:44:57.576075 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-202f5ae1-4fa5-4529-b5a5-9aa9bc29b7f4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:57.576703 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-202f5ae1-4fa5-4529-b5a5-9aa9bc29b7f4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:57.579314 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=31 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:57.580156 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=83 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:57.585768 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-202f5ae1-4fa5-4529-b5a5-9aa9bc29b7f4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:57.586394 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-202f5ae1-4fa5-4529-b5a5-9aa9bc29b7f4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:57.586834 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-202f5ae1-4fa5-4529-b5a5-9aa9bc29b7f4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:57.587535 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-202f5ae1-4fa5-4529-b5a5-9aa9bc29b7f4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:57.588028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-202f5ae1-4fa5-4529-b5a5-9aa9bc29b7f4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:57.588430 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-202f5ae1-4fa5-4529-b5a5-9aa9bc29b7f4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:57.731964 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-202f5ae1-4fa5-4529-b5a5-9aa9bc29b7f4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:57.740676 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-202f5ae1-4fa5-4529-b5a5-9aa9bc29b7f4 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1570 microversion: 2.1 time: 0.168406 Aug 22 05:44:57.741277 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 348/681] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:57 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:58.762595 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8ea285b7-e190-4a01-9336-f153d659b2aa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:58.763352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8ea285b7-e190-4a01-9336-f153d659b2aa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:58.770220 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ea285b7-e190-4a01-9336-f153d659b2aa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:58.770701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ea285b7-e190-4a01-9336-f153d659b2aa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:58.771130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ea285b7-e190-4a01-9336-f153d659b2aa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:58.771848 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ea285b7-e190-4a01-9336-f153d659b2aa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:58.772294 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ea285b7-e190-4a01-9336-f153d659b2aa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:58.772734 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ea285b7-e190-4a01-9336-f153d659b2aa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:58.924822 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8ea285b7-e190-4a01-9336-f153d659b2aa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:44:58.933292 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8ea285b7-e190-4a01-9336-f153d659b2aa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1570 microversion: 2.1 time: 0.175568 Aug 22 05:44:58.933871 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 334/682] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:58 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:44:59.954744 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b2e177f2-2f1b-4ef2-a9f4-88c4ce207d27 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:44:59.955352 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b2e177f2-2f1b-4ef2-a9f4-88c4ce207d27 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:44:59.962302 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b2e177f2-2f1b-4ef2-a9f4-88c4ce207d27 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:59.962811 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b2e177f2-2f1b-4ef2-a9f4-88c4ce207d27 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:59.963234 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b2e177f2-2f1b-4ef2-a9f4-88c4ce207d27 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:44:59.963983 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b2e177f2-2f1b-4ef2-a9f4-88c4ce207d27 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:44:59.964420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b2e177f2-2f1b-4ef2-a9f4-88c4ce207d27 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:44:59.965222 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b2e177f2-2f1b-4ef2-a9f4-88c4ce207d27 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:00.105113 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b2e177f2-2f1b-4ef2-a9f4-88c4ce207d27 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:00.114657 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b2e177f2-2f1b-4ef2-a9f4-88c4ce207d27 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1570 microversion: 2.1 time: 0.163905 Aug 22 05:45:00.115169 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 349/683] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:44:59 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:01.147350 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f2f1f284-e0ee-47a5-831c-ff51be184d5b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:01.148449 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f2f1f284-e0ee-47a5-831c-ff51be184d5b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:01.158326 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2f1f284-e0ee-47a5-831c-ff51be184d5b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:01.158739 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2f1f284-e0ee-47a5-831c-ff51be184d5b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:01.159156 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2f1f284-e0ee-47a5-831c-ff51be184d5b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:01.159893 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2f1f284-e0ee-47a5-831c-ff51be184d5b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:01.160345 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2f1f284-e0ee-47a5-831c-ff51be184d5b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:01.160765 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2f1f284-e0ee-47a5-831c-ff51be184d5b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:01.307808 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f2f1f284-e0ee-47a5-831c-ff51be184d5b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:01.316064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f2f1f284-e0ee-47a5-831c-ff51be184d5b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1570 microversion: 2.1 time: 0.175296 Aug 22 05:45:01.316609 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 335/684] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:01 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:02.337295 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0f4b44fe-9985-450f-beaf-c161cd655acf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:02.337904 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0f4b44fe-9985-450f-beaf-c161cd655acf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:02.345076 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0f4b44fe-9985-450f-beaf-c161cd655acf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:02.345551 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0f4b44fe-9985-450f-beaf-c161cd655acf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:02.345973 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0f4b44fe-9985-450f-beaf-c161cd655acf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:02.346654 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0f4b44fe-9985-450f-beaf-c161cd655acf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:02.347094 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0f4b44fe-9985-450f-beaf-c161cd655acf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:02.347506 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0f4b44fe-9985-450f-beaf-c161cd655acf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:02.487256 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0f4b44fe-9985-450f-beaf-c161cd655acf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:02.498867 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0f4b44fe-9985-450f-beaf-c161cd655acf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1570 microversion: 2.1 time: 0.165094 Aug 22 05:45:02.499635 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 350/685] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:02 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:03.524464 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-50bf479d-b5e7-47c6-9350-ed383d332d26 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:03.525473 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-50bf479d-b5e7-47c6-9350-ed383d332d26 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:03.535433 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-50bf479d-b5e7-47c6-9350-ed383d332d26 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:03.535953 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-50bf479d-b5e7-47c6-9350-ed383d332d26 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:03.536383 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-50bf479d-b5e7-47c6-9350-ed383d332d26 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:03.537120 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-50bf479d-b5e7-47c6-9350-ed383d332d26 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:03.537560 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-50bf479d-b5e7-47c6-9350-ed383d332d26 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:03.537978 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-50bf479d-b5e7-47c6-9350-ed383d332d26 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:03.691152 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-50bf479d-b5e7-47c6-9350-ed383d332d26 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:03.703036 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-50bf479d-b5e7-47c6-9350-ed383d332d26 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1570 microversion: 2.1 time: 0.184721 Aug 22 05:45:03.703906 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 336/686] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:03 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:04.726187 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-2cedf5c4-1df7-46ef-90af-423b2198edfa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:04.726822 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-2cedf5c4-1df7-46ef-90af-423b2198edfa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:04.733773 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2cedf5c4-1df7-46ef-90af-423b2198edfa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:04.734267 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2cedf5c4-1df7-46ef-90af-423b2198edfa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:04.734792 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2cedf5c4-1df7-46ef-90af-423b2198edfa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:04.735474 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2cedf5c4-1df7-46ef-90af-423b2198edfa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:04.736056 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2cedf5c4-1df7-46ef-90af-423b2198edfa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:04.736687 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2cedf5c4-1df7-46ef-90af-423b2198edfa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:04.871501 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-2cedf5c4-1df7-46ef-90af-423b2198edfa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:04.879863 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-2cedf5c4-1df7-46ef-90af-423b2198edfa tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1570 microversion: 2.1 time: 0.157532 Aug 22 05:45:04.880430 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 351/687] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:04 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:05.905788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ecf442ef-37f6-4d65-8756-480d49348b7a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:05.906794 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ecf442ef-37f6-4d65-8756-480d49348b7a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:05.917870 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ecf442ef-37f6-4d65-8756-480d49348b7a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:05.918781 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ecf442ef-37f6-4d65-8756-480d49348b7a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:05.919501 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ecf442ef-37f6-4d65-8756-480d49348b7a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:05.920699 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ecf442ef-37f6-4d65-8756-480d49348b7a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:05.921465 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ecf442ef-37f6-4d65-8756-480d49348b7a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:05.922161 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ecf442ef-37f6-4d65-8756-480d49348b7a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:06.068866 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ecf442ef-37f6-4d65-8756-480d49348b7a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:06.077083 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ecf442ef-37f6-4d65-8756-480d49348b7a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1570 microversion: 2.1 time: 0.178422 Aug 22 05:45:06.077650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 337/688] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:05 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:07.103057 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-d8a88d86-aa1f-4227-b4ff-b164454f57c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:07.104020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-d8a88d86-aa1f-4227-b4ff-b164454f57c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:07.114930 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d8a88d86-aa1f-4227-b4ff-b164454f57c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:07.115775 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d8a88d86-aa1f-4227-b4ff-b164454f57c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:07.116483 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d8a88d86-aa1f-4227-b4ff-b164454f57c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:07.117604 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d8a88d86-aa1f-4227-b4ff-b164454f57c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:07.118343 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d8a88d86-aa1f-4227-b4ff-b164454f57c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:07.119035 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d8a88d86-aa1f-4227-b4ff-b164454f57c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:07.271091 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-d8a88d86-aa1f-4227-b4ff-b164454f57c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:07.279265 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-d8a88d86-aa1f-4227-b4ff-b164454f57c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1570 microversion: 2.1 time: 0.182603 Aug 22 05:45:07.279840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 352/689] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:07 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:08.300478 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4b4042d2-0592-4cba-ab98-b120eb8623b2 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:08.301094 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4b4042d2-0592-4cba-ab98-b120eb8623b2 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:08.308043 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b4042d2-0592-4cba-ab98-b120eb8623b2 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:08.308589 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b4042d2-0592-4cba-ab98-b120eb8623b2 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:08.309019 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b4042d2-0592-4cba-ab98-b120eb8623b2 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:08.309697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b4042d2-0592-4cba-ab98-b120eb8623b2 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:08.310137 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b4042d2-0592-4cba-ab98-b120eb8623b2 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:08.310547 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b4042d2-0592-4cba-ab98-b120eb8623b2 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:08.459247 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4b4042d2-0592-4cba-ab98-b120eb8623b2 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:08.467783 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4b4042d2-0592-4cba-ab98-b120eb8623b2 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1570 microversion: 2.1 time: 0.171243 Aug 22 05:45:08.468353 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 338/690] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:08 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:09.492745 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8f030d44-6253-49c6-b0f9-a076a0d3283e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:09.493674 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8f030d44-6253-49c6-b0f9-a076a0d3283e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:09.504959 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8f030d44-6253-49c6-b0f9-a076a0d3283e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:09.505861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8f030d44-6253-49c6-b0f9-a076a0d3283e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:09.506589 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8f030d44-6253-49c6-b0f9-a076a0d3283e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:09.507759 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8f030d44-6253-49c6-b0f9-a076a0d3283e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:09.508516 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8f030d44-6253-49c6-b0f9-a076a0d3283e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:09.509222 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8f030d44-6253-49c6-b0f9-a076a0d3283e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:09.662213 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8f030d44-6253-49c6-b0f9-a076a0d3283e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:09.670372 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8f030d44-6253-49c6-b0f9-a076a0d3283e tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1570 microversion: 2.1 time: 0.184403 Aug 22 05:45:09.670949 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 353/691] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:09 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:10.692354 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c4a46641-d66d-4309-a17d-7cbd415cc2b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:10.693086 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c4a46641-d66d-4309-a17d-7cbd415cc2b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:10.699325 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4a46641-d66d-4309-a17d-7cbd415cc2b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:10.699915 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4a46641-d66d-4309-a17d-7cbd415cc2b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:10.700343 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4a46641-d66d-4309-a17d-7cbd415cc2b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:10.701031 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4a46641-d66d-4309-a17d-7cbd415cc2b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:10.701476 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4a46641-d66d-4309-a17d-7cbd415cc2b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:10.701888 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4a46641-d66d-4309-a17d-7cbd415cc2b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:10.839324 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c4a46641-d66d-4309-a17d-7cbd415cc2b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:10.847770 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c4a46641-d66d-4309-a17d-7cbd415cc2b0 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1571 microversion: 2.1 time: 0.159436 Aug 22 05:45:10.848436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 339/692] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:10 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:10.873018 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0a9576a0-aa3f-4ab2-8873-c4266b357ad3 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:10.874131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0a9576a0-aa3f-4ab2-8873-c4266b357ad3 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:10.882926 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a9576a0-aa3f-4ab2-8873-c4266b357ad3 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:10.883407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a9576a0-aa3f-4ab2-8873-c4266b357ad3 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:10.883860 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a9576a0-aa3f-4ab2-8873-c4266b357ad3 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:10.884552 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a9576a0-aa3f-4ab2-8873-c4266b357ad3 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:10.884998 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a9576a0-aa3f-4ab2-8873-c4266b357ad3 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:10.885417 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a9576a0-aa3f-4ab2-8873-c4266b357ad3 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:10.973180 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0a9576a0-aa3f-4ab2-8873-c4266b357ad3 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132497) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 05:45:11.046399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0a9576a0-aa3f-4ab2-8873-c4266b357ad3 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "POST /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94/action" status: 202 len: 0 microversion: 2.1 time: 0.180230 Aug 22 05:45:11.047031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 354/693] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 22 05:45:10 2022] POST /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:45:11.055287 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-063668d8-749d-4b8b-a309-5809258cb092 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:11.055923 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-063668d8-749d-4b8b-a309-5809258cb092 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:11.061859 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-063668d8-749d-4b8b-a309-5809258cb092 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:11.062333 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-063668d8-749d-4b8b-a309-5809258cb092 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:11.062953 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-063668d8-749d-4b8b-a309-5809258cb092 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:11.063667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-063668d8-749d-4b8b-a309-5809258cb092 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:11.064127 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-063668d8-749d-4b8b-a309-5809258cb092 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:11.064520 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-063668d8-749d-4b8b-a309-5809258cb092 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:11.196635 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-063668d8-749d-4b8b-a309-5809258cb092 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:11.205008 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-063668d8-749d-4b8b-a309-5809258cb092 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1519 microversion: 2.1 time: 0.153496 Aug 22 05:45:11.205739 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 340/694] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:11 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:12.226798 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4809e662-bf32-410a-b1c1-a2cddeb89061 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:12.227394 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4809e662-bf32-410a-b1c1-a2cddeb89061 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:12.233376 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4809e662-bf32-410a-b1c1-a2cddeb89061 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:12.233858 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4809e662-bf32-410a-b1c1-a2cddeb89061 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:12.234290 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4809e662-bf32-410a-b1c1-a2cddeb89061 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:12.234977 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4809e662-bf32-410a-b1c1-a2cddeb89061 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:12.235424 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4809e662-bf32-410a-b1c1-a2cddeb89061 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:12.235866 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4809e662-bf32-410a-b1c1-a2cddeb89061 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:12.378861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4809e662-bf32-410a-b1c1-a2cddeb89061 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:12.387046 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4809e662-bf32-410a-b1c1-a2cddeb89061 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1521 microversion: 2.1 time: 0.164837 Aug 22 05:45:12.387660 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 355/695] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:12 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:13.040659 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-7937775a-2450-4c84-b247-8c28ac1d34ca req-3dfebb7e-172b-4bf2-ba7d-0ef919bb65b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57433a27-1ab9-4b19-b87b-fc2c80644b94", "name": "network-vif-unplugged", "status": "completed", "tag": "d68e991c-9283-490b-b88a-5d68f84a5bd6"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:13.052006 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7937775a-2450-4c84-b247-8c28ac1d34ca req-3dfebb7e-172b-4bf2-ba7d-0ef919bb65b6 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:13.052944 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7937775a-2450-4c84-b247-8c28ac1d34ca req-3dfebb7e-172b-4bf2-ba7d-0ef919bb65b6 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:13.053588 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7937775a-2450-4c84-b247-8c28ac1d34ca req-3dfebb7e-172b-4bf2-ba7d-0ef919bb65b6 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:13.066235 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-7937775a-2450-4c84-b247-8c28ac1d34ca req-3dfebb7e-172b-4bf2-ba7d-0ef919bb65b6 service nova] Creating event network-vif-unplugged:d68e991c-9283-490b-b88a-5d68f84a5bd6 for instance 57433a27-1ab9-4b19-b87b-fc2c80644b94 on hv-cinder-85391 Aug 22 05:45:13.071758 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-7937775a-2450-4c84-b247-8c28ac1d34ca req-3dfebb7e-172b-4bf2-ba7d-0ef919bb65b6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034724 Aug 22 05:45:13.072445 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 341/696] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:45:13.410854 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0e3c72c8-f63e-405e-a26f-6cf974ed136b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:13.411511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0e3c72c8-f63e-405e-a26f-6cf974ed136b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:13.418942 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0e3c72c8-f63e-405e-a26f-6cf974ed136b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:13.419416 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0e3c72c8-f63e-405e-a26f-6cf974ed136b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:13.419866 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0e3c72c8-f63e-405e-a26f-6cf974ed136b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:13.420587 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0e3c72c8-f63e-405e-a26f-6cf974ed136b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:13.421032 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0e3c72c8-f63e-405e-a26f-6cf974ed136b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:13.421448 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0e3c72c8-f63e-405e-a26f-6cf974ed136b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:13.702732 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0e3c72c8-f63e-405e-a26f-6cf974ed136b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:13.710684 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0e3c72c8-f63e-405e-a26f-6cf974ed136b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1577 microversion: 2.1 time: 0.303884 Aug 22 05:45:13.711252 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 356/697] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:13 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1577 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:14.738410 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e1df4228-0c9b-4c3d-be01-b093965342c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:14.739512 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e1df4228-0c9b-4c3d-be01-b093965342c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:14.750302 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e1df4228-0c9b-4c3d-be01-b093965342c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:14.751102 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e1df4228-0c9b-4c3d-be01-b093965342c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:14.751877 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e1df4228-0c9b-4c3d-be01-b093965342c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:14.753017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e1df4228-0c9b-4c3d-be01-b093965342c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:14.753751 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e1df4228-0c9b-4c3d-be01-b093965342c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:14.754419 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e1df4228-0c9b-4c3d-be01-b093965342c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:14.905202 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e1df4228-0c9b-4c3d-be01-b093965342c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:14.913843 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e1df4228-0c9b-4c3d-be01-b093965342c7 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1577 microversion: 2.1 time: 0.183355 Aug 22 05:45:14.914612 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 342/698] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:14 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:15.934788 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-957cdf69-58fd-4a2a-8a9b-247c90b082b1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:15.935399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-957cdf69-58fd-4a2a-8a9b-247c90b082b1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:15.942386 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-957cdf69-58fd-4a2a-8a9b-247c90b082b1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:15.942866 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-957cdf69-58fd-4a2a-8a9b-247c90b082b1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:15.943292 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-957cdf69-58fd-4a2a-8a9b-247c90b082b1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:15.944292 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-957cdf69-58fd-4a2a-8a9b-247c90b082b1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:15.944741 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-957cdf69-58fd-4a2a-8a9b-247c90b082b1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:15.945158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-957cdf69-58fd-4a2a-8a9b-247c90b082b1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:16.086715 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-957cdf69-58fd-4a2a-8a9b-247c90b082b1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:16.098554 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-957cdf69-58fd-4a2a-8a9b-247c90b082b1 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1577 microversion: 2.1 time: 0.167432 Aug 22 05:45:16.099390 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 357/699] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:15 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:17.130448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f2c4d058-a871-473a-81bb-5cd1f92a9527 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:17.131730 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f2c4d058-a871-473a-81bb-5cd1f92a9527 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:17.139181 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2c4d058-a871-473a-81bb-5cd1f92a9527 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:17.139747 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2c4d058-a871-473a-81bb-5cd1f92a9527 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:17.140223 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2c4d058-a871-473a-81bb-5cd1f92a9527 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:17.141046 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2c4d058-a871-473a-81bb-5cd1f92a9527 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:17.141537 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2c4d058-a871-473a-81bb-5cd1f92a9527 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:17.141997 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2c4d058-a871-473a-81bb-5cd1f92a9527 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:17.285758 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f2c4d058-a871-473a-81bb-5cd1f92a9527 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:17.293828 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f2c4d058-a871-473a-81bb-5cd1f92a9527 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1577 microversion: 2.1 time: 0.169914 Aug 22 05:45:17.294399 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 343/700] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:17 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:18.318524 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e79dcc0a-25f3-4fb1-a2b0-73c8521fc080 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:18.319783 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e79dcc0a-25f3-4fb1-a2b0-73c8521fc080 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:18.330579 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e79dcc0a-25f3-4fb1-a2b0-73c8521fc080 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:18.331326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e79dcc0a-25f3-4fb1-a2b0-73c8521fc080 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:18.332078 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e79dcc0a-25f3-4fb1-a2b0-73c8521fc080 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:18.333237 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e79dcc0a-25f3-4fb1-a2b0-73c8521fc080 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:18.334001 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e79dcc0a-25f3-4fb1-a2b0-73c8521fc080 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:18.334656 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e79dcc0a-25f3-4fb1-a2b0-73c8521fc080 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:18.470509 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e79dcc0a-25f3-4fb1-a2b0-73c8521fc080 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:18.480545 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e79dcc0a-25f3-4fb1-a2b0-73c8521fc080 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1577 microversion: 2.1 time: 0.168758 Aug 22 05:45:18.481112 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 358/701] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:18 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:19.505841 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f4481384-4faa-42b2-8526-4146f585a2da tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:19.506833 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f4481384-4faa-42b2-8526-4146f585a2da tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:19.514289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4481384-4faa-42b2-8526-4146f585a2da tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:19.514798 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4481384-4faa-42b2-8526-4146f585a2da tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:19.515200 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4481384-4faa-42b2-8526-4146f585a2da tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:19.515922 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4481384-4faa-42b2-8526-4146f585a2da tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:19.516370 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4481384-4faa-42b2-8526-4146f585a2da tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:19.516786 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4481384-4faa-42b2-8526-4146f585a2da tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:19.678452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f4481384-4faa-42b2-8526-4146f585a2da tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:19.687067 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f4481384-4faa-42b2-8526-4146f585a2da tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1577 microversion: 2.1 time: 0.187749 Aug 22 05:45:19.687671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 344/702] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:19 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:20.715380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-454d6c74-5c71-4cc4-9af3-d5b8c04a5c9b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:20.716482 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-454d6c74-5c71-4cc4-9af3-d5b8c04a5c9b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:20.727067 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-454d6c74-5c71-4cc4-9af3-d5b8c04a5c9b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:20.727539 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-454d6c74-5c71-4cc4-9af3-d5b8c04a5c9b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:20.728014 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-454d6c74-5c71-4cc4-9af3-d5b8c04a5c9b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:20.728708 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-454d6c74-5c71-4cc4-9af3-d5b8c04a5c9b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:20.729163 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-454d6c74-5c71-4cc4-9af3-d5b8c04a5c9b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:20.729581 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-454d6c74-5c71-4cc4-9af3-d5b8c04a5c9b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:20.874915 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-454d6c74-5c71-4cc4-9af3-d5b8c04a5c9b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:20.885576 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-454d6c74-5c71-4cc4-9af3-d5b8c04a5c9b tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1577 microversion: 2.1 time: 0.178933 Aug 22 05:45:20.886145 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 359/703] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:20 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:21.908287 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d91acadd-a24f-45e8-9c51-d9628d2f82dd tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:21.908918 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d91acadd-a24f-45e8-9c51-d9628d2f82dd tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:21.915806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d91acadd-a24f-45e8-9c51-d9628d2f82dd tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:21.916285 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d91acadd-a24f-45e8-9c51-d9628d2f82dd tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:21.916719 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d91acadd-a24f-45e8-9c51-d9628d2f82dd tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:21.917378 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d91acadd-a24f-45e8-9c51-d9628d2f82dd tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:21.917824 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d91acadd-a24f-45e8-9c51-d9628d2f82dd tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:21.918235 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d91acadd-a24f-45e8-9c51-d9628d2f82dd tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:22.059782 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d91acadd-a24f-45e8-9c51-d9628d2f82dd tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:22.067694 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d91acadd-a24f-45e8-9c51-d9628d2f82dd tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1577 microversion: 2.1 time: 0.163735 Aug 22 05:45:22.068250 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 345/704] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:21 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:23.090916 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5d8595f3-0879-4613-8936-a0c0f76b7782 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:23.091530 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5d8595f3-0879-4613-8936-a0c0f76b7782 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:23.097939 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5d8595f3-0879-4613-8936-a0c0f76b7782 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:23.098648 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5d8595f3-0879-4613-8936-a0c0f76b7782 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:23.099060 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5d8595f3-0879-4613-8936-a0c0f76b7782 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:23.099774 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5d8595f3-0879-4613-8936-a0c0f76b7782 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:23.100404 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5d8595f3-0879-4613-8936-a0c0f76b7782 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:23.100810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5d8595f3-0879-4613-8936-a0c0f76b7782 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:23.307140 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5d8595f3-0879-4613-8936-a0c0f76b7782 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:23.315770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5d8595f3-0879-4613-8936-a0c0f76b7782 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1564 microversion: 2.1 time: 0.229063 Aug 22 05:45:23.316339 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 360/705] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:23 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1564 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:25.265393 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-0d0eee1d-d7de-4e08-8152-04349cfc6278 req-48d32651-39d8-462e-9be3-e082cfc2ea42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57433a27-1ab9-4b19-b87b-fc2c80644b94", "name": "network-vif-plugged", "status": "completed", "tag": "d68e991c-9283-490b-b88a-5d68f84a5bd6"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:25.276168 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-0d0eee1d-d7de-4e08-8152-04349cfc6278 req-48d32651-39d8-462e-9be3-e082cfc2ea42 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:25.276641 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-0d0eee1d-d7de-4e08-8152-04349cfc6278 req-48d32651-39d8-462e-9be3-e082cfc2ea42 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:25.277057 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-0d0eee1d-d7de-4e08-8152-04349cfc6278 req-48d32651-39d8-462e-9be3-e082cfc2ea42 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:25.291466 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-0d0eee1d-d7de-4e08-8152-04349cfc6278 req-48d32651-39d8-462e-9be3-e082cfc2ea42 service nova] Creating event network-vif-plugged:d68e991c-9283-490b-b88a-5d68f84a5bd6 for instance 57433a27-1ab9-4b19-b87b-fc2c80644b94 on hv-cinder-85391 Aug 22 05:45:25.296129 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-0d0eee1d-d7de-4e08-8152-04349cfc6278 req-48d32651-39d8-462e-9be3-e082cfc2ea42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034559 Aug 22 05:45:25.297100 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 346/706] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:45:25.993952 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-53b9d428-1bd6-4fcf-9405-8fdaa838446b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:25.996233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-53b9d428-1bd6-4fcf-9405-8fdaa838446b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:26.003209 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-53b9d428-1bd6-4fcf-9405-8fdaa838446b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:26.003727 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-53b9d428-1bd6-4fcf-9405-8fdaa838446b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:26.004159 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-53b9d428-1bd6-4fcf-9405-8fdaa838446b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:26.004838 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-53b9d428-1bd6-4fcf-9405-8fdaa838446b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:26.005257 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-53b9d428-1bd6-4fcf-9405-8fdaa838446b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:26.005668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-53b9d428-1bd6-4fcf-9405-8fdaa838446b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:26.036712 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-53b9d428-1bd6-4fcf-9405-8fdaa838446b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046335 Aug 22 05:45:26.037441 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 361/707] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 22 05:45:25 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 05:45:26.102430 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c1237e41-2fb9-4947-a846-0396cc5186ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:26.103001 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c1237e41-2fb9-4947-a846-0396cc5186ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:26.109765 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1237e41-2fb9-4947-a846-0396cc5186ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:26.110239 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1237e41-2fb9-4947-a846-0396cc5186ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:26.110668 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1237e41-2fb9-4947-a846-0396cc5186ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:26.111341 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1237e41-2fb9-4947-a846-0396cc5186ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:26.111817 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1237e41-2fb9-4947-a846-0396cc5186ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:26.112222 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1237e41-2fb9-4947-a846-0396cc5186ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:26.141000 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c1237e41-2fb9-4947-a846-0396cc5186ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:45:26.179410 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:45:26.236844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c1237e41-2fb9-4947-a846-0396cc5186ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "DELETE /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 204 len: 0 microversion: 2.1 time: 0.138345 Aug 22 05:45:26.238155 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 347/708] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:45:26 2022] DELETE /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:45:26.246674 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-cf097ac4-aeb0-4eb9-a401-e820be5ef6e5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:26.247314 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-cf097ac4-aeb0-4eb9-a401-e820be5ef6e5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:26.253634 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cf097ac4-aeb0-4eb9-a401-e820be5ef6e5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:26.254107 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cf097ac4-aeb0-4eb9-a401-e820be5ef6e5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:26.254512 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cf097ac4-aeb0-4eb9-a401-e820be5ef6e5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:26.255193 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cf097ac4-aeb0-4eb9-a401-e820be5ef6e5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:26.255642 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cf097ac4-aeb0-4eb9-a401-e820be5ef6e5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:26.256071 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cf097ac4-aeb0-4eb9-a401-e820be5ef6e5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:26.389453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-cf097ac4-aeb0-4eb9-a401-e820be5ef6e5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:26.397514 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-cf097ac4-aeb0-4eb9-a401-e820be5ef6e5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1672 microversion: 2.1 time: 0.155085 Aug 22 05:45:26.398092 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 362/709] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:26 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:27.420183 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2793263e-80df-4ee8-ac3b-9019d06c191d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:27.420940 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2793263e-80df-4ee8-ac3b-9019d06c191d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:27.425299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:45:27.430874 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2793263e-80df-4ee8-ac3b-9019d06c191d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:27.431730 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2793263e-80df-4ee8-ac3b-9019d06c191d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:27.432169 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2793263e-80df-4ee8-ac3b-9019d06c191d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:27.432986 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2793263e-80df-4ee8-ac3b-9019d06c191d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:27.433436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2793263e-80df-4ee8-ac3b-9019d06c191d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:27.433888 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2793263e-80df-4ee8-ac3b-9019d06c191d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:27.470727 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a772d0ff-db50-4acc-88d7-367ff3926be5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:27.471377 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a772d0ff-db50-4acc-88d7-367ff3926be5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:27.477720 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a772d0ff-db50-4acc-88d7-367ff3926be5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:27.478198 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a772d0ff-db50-4acc-88d7-367ff3926be5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:27.478625 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a772d0ff-db50-4acc-88d7-367ff3926be5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:27.479315 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a772d0ff-db50-4acc-88d7-367ff3926be5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:27.479785 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a772d0ff-db50-4acc-88d7-367ff3926be5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:27.480197 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a772d0ff-db50-4acc-88d7-367ff3926be5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:27.539173 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:45:27.610719 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.objects.instance [None req-a772d0ff-db50-4acc-88d7-367ff3926be5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lazy-loading 'services' on Instance uuid 38c93cef-e688-4d2c-ad3d-508c12c362f3 {{(pid=132497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:45:27.693031 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2793263e-80df-4ee8-ac3b-9019d06c191d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:27.701449 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2793263e-80df-4ee8-ac3b-9019d06c191d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1672 microversion: 2.1 time: 0.286021 Aug 22 05:45:27.712130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 348/710] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:27 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1672 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:27.751879 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a772d0ff-db50-4acc-88d7-367ff3926be5 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "DELETE /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/os-volume_attachments/4953c424-ce7d-4eca-818c-6c54c5a591ec" status: 202 len: 0 microversion: 2.1 time: 0.285237 Aug 22 05:45:27.752474 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 363/711] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 22 05:45:27 2022] DELETE /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/os-volume_attachments/4953c424-ce7d-4eca-818c-6c54c5a591ec => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:45:27.761422 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8a02a1b1-8a38-47db-bcca-455c2cbe1462 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:27.763587 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8a02a1b1-8a38-47db-bcca-455c2cbe1462 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:27.769977 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a02a1b1-8a38-47db-bcca-455c2cbe1462 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:27.770462 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a02a1b1-8a38-47db-bcca-455c2cbe1462 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:27.775441 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a02a1b1-8a38-47db-bcca-455c2cbe1462 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:27.776232 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a02a1b1-8a38-47db-bcca-455c2cbe1462 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:27.776697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a02a1b1-8a38-47db-bcca-455c2cbe1462 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:27.777123 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a02a1b1-8a38-47db-bcca-455c2cbe1462 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:27.812175 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8a02a1b1-8a38-47db-bcca-455c2cbe1462 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054597 Aug 22 05:45:27.812971 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 349/712] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 22 05:45:27 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:45:28.458094 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-cc5f32a6-2a00-4586-9ef2-723611aed642 req-2c186af6-2d4c-48d4-98f6-409a257b162d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "585fdc4d-a711-4748-9480-bb5a9bab88f4", "name": "network-vif-deleted", "tag": "1b1f5f40-5b3a-4135-85ac-8b7ecf8f98f5"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:28.466100 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:45:28.489693 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-cc5f32a6-2a00-4586-9ef2-723611aed642 req-2c186af6-2d4c-48d4-98f6-409a257b162d service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:28.490399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-cc5f32a6-2a00-4586-9ef2-723611aed642 req-2c186af6-2d4c-48d4-98f6-409a257b162d service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:28.490575 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-cc5f32a6-2a00-4586-9ef2-723611aed642 req-2c186af6-2d4c-48d4-98f6-409a257b162d service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:28.503980 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-cc5f32a6-2a00-4586-9ef2-723611aed642 req-2c186af6-2d4c-48d4-98f6-409a257b162d service nova] Creating event network-vif-deleted:1b1f5f40-5b3a-4135-85ac-8b7ecf8f98f5 for instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 on hv-cinder-85391 Aug 22 05:45:28.510423 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-cc5f32a6-2a00-4586-9ef2-723611aed642 req-2c186af6-2d4c-48d4-98f6-409a257b162d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057181 Aug 22 05:45:28.511614 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 364/713] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:45:28.724410 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6954df83-bec9-4731-bc5e-ab6bb98d7194 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:28.725019 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6954df83-bec9-4731-bc5e-ab6bb98d7194 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:28.731899 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6954df83-bec9-4731-bc5e-ab6bb98d7194 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:28.733814 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6954df83-bec9-4731-bc5e-ab6bb98d7194 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:28.734244 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6954df83-bec9-4731-bc5e-ab6bb98d7194 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:28.734977 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6954df83-bec9-4731-bc5e-ab6bb98d7194 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:28.735433 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6954df83-bec9-4731-bc5e-ab6bb98d7194 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:28.735871 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6954df83-bec9-4731-bc5e-ab6bb98d7194 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:28.770677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6954df83-bec9-4731-bc5e-ab6bb98d7194 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:28.771148 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6954df83-bec9-4731-bc5e-ab6bb98d7194 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:28.771596 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6954df83-bec9-4731-bc5e-ab6bb98d7194 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:28.772145 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-6954df83-bec9-4731-bc5e-ab6bb98d7194 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lazy-loading 'fault' on Instance uuid 585fdc4d-a711-4748-9480-bb5a9bab88f4 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:45:28.819390 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6954df83-bec9-4731-bc5e-ab6bb98d7194 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:28.825578 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-89da4bbd-0aa4-4023-b883-e219a7f9ce7d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:28.828428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-89da4bbd-0aa4-4023-b883-e219a7f9ce7d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:28.831814 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6954df83-bec9-4731-bc5e-ab6bb98d7194 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 200 len: 1326 microversion: 2.1 time: 0.111094 Aug 22 05:45:28.832772 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 350/714] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:28 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 1326 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:28.837697 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-89da4bbd-0aa4-4023-b883-e219a7f9ce7d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:28.838608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-89da4bbd-0aa4-4023-b883-e219a7f9ce7d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:28.839212 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-89da4bbd-0aa4-4023-b883-e219a7f9ce7d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:28.840457 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-89da4bbd-0aa4-4023-b883-e219a7f9ce7d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:28.841266 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-89da4bbd-0aa4-4023-b883-e219a7f9ce7d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:28.841850 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-89da4bbd-0aa4-4023-b883-e219a7f9ce7d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:28.885559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-89da4bbd-0aa4-4023-b883-e219a7f9ce7d tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064436 Aug 22 05:45:28.886146 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 365/715] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 22 05:45:28 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 05:45:28.996873 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c139760d-0cd0-4795-828c-99e32256a656 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:28.997625 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c139760d-0cd0-4795-828c-99e32256a656 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:29.004831 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c139760d-0cd0-4795-828c-99e32256a656 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:29.005681 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c139760d-0cd0-4795-828c-99e32256a656 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:29.006543 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c139760d-0cd0-4795-828c-99e32256a656 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:29.007420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c139760d-0cd0-4795-828c-99e32256a656 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:29.008203 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c139760d-0cd0-4795-828c-99e32256a656 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:29.008804 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c139760d-0cd0-4795-828c-99e32256a656 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:29.036301 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c139760d-0cd0-4795-828c-99e32256a656 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Going to try to terminate instance {{(pid=132497) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:45:29.125370 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3f3b876e-bd3a-47c5-ab0d-b6a83ac14637 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:29.126071 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3f3b876e-bd3a-47c5-ab0d-b6a83ac14637 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:29.137002 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f3b876e-bd3a-47c5-ab0d-b6a83ac14637 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:29.137633 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f3b876e-bd3a-47c5-ab0d-b6a83ac14637 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:29.138173 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f3b876e-bd3a-47c5-ab0d-b6a83ac14637 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:29.141757 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f3b876e-bd3a-47c5-ab0d-b6a83ac14637 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:29.142465 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f3b876e-bd3a-47c5-ab0d-b6a83ac14637 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:29.143069 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f3b876e-bd3a-47c5-ab0d-b6a83ac14637 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:29.160423 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c139760d-0cd0-4795-828c-99e32256a656 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "DELETE /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 204 len: 0 microversion: 2.1 time: 0.166775 Aug 22 05:45:29.161548 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 366/716] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:45:28 2022] DELETE /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:45:29.173588 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0139595d-fb69-4ebe-a1ea-5ecdca9eb4f6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:29.174664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0139595d-fb69-4ebe-a1ea-5ecdca9eb4f6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:29.183591 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3f3b876e-bd3a-47c5-ab0d-b6a83ac14637 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-volume_attachments/db29990f-bb6a-4f9b-9a40-447a84dd8991" status: 200 len: 194 microversion: 2.20 time: 0.204925 Aug 22 05:45:29.186039 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0139595d-fb69-4ebe-a1ea-5ecdca9eb4f6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:29.186591 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0139595d-fb69-4ebe-a1ea-5ecdca9eb4f6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:29.187087 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0139595d-fb69-4ebe-a1ea-5ecdca9eb4f6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:29.187915 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 351/717] 10.222.0.18 () {60 vars in 1454 bytes} [Mon Aug 22 05:45:28 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-volume_attachments/db29990f-bb6a-4f9b-9a40-447a84dd8991 => generated 194 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:45:29.194013 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0139595d-fb69-4ebe-a1ea-5ecdca9eb4f6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:29.194013 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0139595d-fb69-4ebe-a1ea-5ecdca9eb4f6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:29.194013 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0139595d-fb69-4ebe-a1ea-5ecdca9eb4f6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:29.263653 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d6e4d369-099b-4826-b536-dd6ab939d3f0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:29.264360 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d6e4d369-099b-4826-b536-dd6ab939d3f0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:29.275768 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6e4d369-099b-4826-b536-dd6ab939d3f0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:29.276533 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6e4d369-099b-4826-b536-dd6ab939d3f0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:29.277123 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6e4d369-099b-4826-b536-dd6ab939d3f0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:29.277966 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6e4d369-099b-4826-b536-dd6ab939d3f0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:29.278614 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6e4d369-099b-4826-b536-dd6ab939d3f0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:29.279184 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6e4d369-099b-4826-b536-dd6ab939d3f0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:29.366670 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-d6e4d369-099b-4826-b536-dd6ab939d3f0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lazy-loading 'services' on Instance uuid 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:45:29.368635 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0139595d-fb69-4ebe-a1ea-5ecdca9eb4f6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:29.377200 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0139595d-fb69-4ebe-a1ea-5ecdca9eb4f6 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1690 microversion: 2.1 time: 0.210162 Aug 22 05:45:29.385161 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 367/718] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:29 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1690 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:29.442803 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d6e4d369-099b-4826-b536-dd6ab939d3f0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "DELETE /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-volume_attachments/db29990f-bb6a-4f9b-9a40-447a84dd8991" status: 202 len: 0 microversion: 2.20 time: 0.183426 Aug 22 05:45:29.446749 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 352/719] 10.222.0.18 () {60 vars in 1457 bytes} [Mon Aug 22 05:45:29 2022] DELETE /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-volume_attachments/db29990f-bb6a-4f9b-9a40-447a84dd8991 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 22 05:45:29.452106 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a0eeffd1-ea44-467d-903b-483f89a43dc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:29.454418 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a0eeffd1-ea44-467d-903b-483f89a43dc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:29.460866 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a0eeffd1-ea44-467d-903b-483f89a43dc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:29.461469 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a0eeffd1-ea44-467d-903b-483f89a43dc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:29.461771 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a0eeffd1-ea44-467d-903b-483f89a43dc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:29.462460 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a0eeffd1-ea44-467d-903b-483f89a43dc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:29.462910 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a0eeffd1-ea44-467d-903b-483f89a43dc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:29.463331 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a0eeffd1-ea44-467d-903b-483f89a43dc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:29.498535 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a0eeffd1-ea44-467d-903b-483f89a43dc6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050318 Aug 22 05:45:29.500785 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 368/720] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Aug 22 05:45:29 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 05:45:29.855307 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e36a4436-ed52-4c40-ab69-1eaebe62bada tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:29.856085 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e36a4436-ed52-4c40-ab69-1eaebe62bada tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:29.863311 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e36a4436-ed52-4c40-ab69-1eaebe62bada tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:29.863830 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e36a4436-ed52-4c40-ab69-1eaebe62bada tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:29.864267 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e36a4436-ed52-4c40-ab69-1eaebe62bada tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:29.864967 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e36a4436-ed52-4c40-ab69-1eaebe62bada tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:29.865405 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e36a4436-ed52-4c40-ab69-1eaebe62bada tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:29.865806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e36a4436-ed52-4c40-ab69-1eaebe62bada tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:29.891176 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-e36a4436-ed52-4c40-ab69-1eaebe62bada tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] HTTP exception thrown: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e36a4436-ed52-4c40-ab69-1eaebe62bada tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Request method failure captured: Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 HTTP/1.1 Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxZNuMuH7w1Aa8XfSCRYyOCz_1_XfsSPHd6uxxEn6WlNYcUmt26Dwsor1l__QiX2FoHdUn46tPS4lmQgwKZxFbEFawOKMGHu7GnvOmxAWqbGPbJz35XLAkIDC19Lgn_hIX0KhQTO7VqzyUKXmawvOB7NBBbS9yLAb6KZQt29Ndb0vkk Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 8e8481f1683045d4a63b3d33e0dab620 Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:45:29.892917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:45:29.894667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8e8481f1683045d4a63b3d33e0dab620", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:45:29.894667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:45:29.894667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 8e8481f1683045d4a63b3d33e0dab620 Aug 22 05:45:29.894667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:45:29.894667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeTestJSON-1597267240-project Aug 22 05:45:29.894667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:45:29.894667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:45:29.894667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 8e68f520aaff495abfb4b7a5271936e1 Aug 22 05:45:29.894667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeTestJSON-1597267240-project Aug 22 05:45:29.894667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:45:29.894667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. Aug 22 05:45:29.894667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '585fdc4d-a711-4748-9480-bb5a9bab88f4'} Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:45:29.895697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. Aug 22 05:45:29.897226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:29.898917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e36a4436-ed52-4c40-ab69-1eaebe62bada tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Returning 404 to user: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:45:29.898917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e36a4436-ed52-4c40-ab69-1eaebe62bada tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 404 len: 111 microversion: 2.1 time: 0.044218 Aug 22 05:45:29.898917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 353/721] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:29 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:45:29.904588 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-622aa40a-2299-4c6b-98c6-4729c838c8f9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '.version_select at 0x7f0b3df3dca0>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:29.928144 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-622aa40a-2299-4c6b-98c6-4729c838c8f9 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-571824452" status: 202 len: 0 microversion: 2.1 time: 0.027650 Aug 22 05:45:29.928837 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 369/722] 10.222.0.18 () {58 vars in 1218 bytes} [Mon Aug 22 05:45:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-571824452 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:45:30.398710 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5d07b458-1a78-48fb-bb47-4c2d99fb1c81 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:30.399403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5d07b458-1a78-48fb-bb47-4c2d99fb1c81 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:30.406215 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d07b458-1a78-48fb-bb47-4c2d99fb1c81 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:30.406743 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d07b458-1a78-48fb-bb47-4c2d99fb1c81 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:30.407175 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d07b458-1a78-48fb-bb47-4c2d99fb1c81 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:30.407916 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d07b458-1a78-48fb-bb47-4c2d99fb1c81 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:30.408367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d07b458-1a78-48fb-bb47-4c2d99fb1c81 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:30.408771 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d07b458-1a78-48fb-bb47-4c2d99fb1c81 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:30.513203 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6863b8ee-3d13-41ac-b5e5-91d3bedc7b01 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:30.515395 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-6863b8ee-3d13-41ac-b5e5-91d3bedc7b01 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:30.523400 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6863b8ee-3d13-41ac-b5e5-91d3bedc7b01 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:30.523929 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6863b8ee-3d13-41ac-b5e5-91d3bedc7b01 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:30.524370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6863b8ee-3d13-41ac-b5e5-91d3bedc7b01 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:30.525102 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6863b8ee-3d13-41ac-b5e5-91d3bedc7b01 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:30.525567 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6863b8ee-3d13-41ac-b5e5-91d3bedc7b01 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:30.525987 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6863b8ee-3d13-41ac-b5e5-91d3bedc7b01 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:30.558865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6863b8ee-3d13-41ac-b5e5-91d3bedc7b01 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050192 Aug 22 05:45:30.563926 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5d07b458-1a78-48fb-bb47-4c2d99fb1c81 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:30.566403 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 370/723] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Aug 22 05:45:30 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:45:30.571450 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5d07b458-1a78-48fb-bb47-4c2d99fb1c81 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1690 microversion: 2.1 time: 0.176670 Aug 22 05:45:30.573411 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 354/724] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:30 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:30.832778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-d4435ef9-8667-4ad3-9a36-abac57270358 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Action: 'create', calling method: .version_select at 0x7f0b427ebca0>, body: {"keypair": {"name": "tempest-keypair-1096199609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqV8AL+a8SPkv9Zc6JV5SRtS3Kkt3odqNO3gDfTpMM6HR+fYw42BUUI0LYjE/0GIEiJIlrxR2Qck29eD+nl5sUgD6EBc+fYokP3f72eeDr3h3ra+VXo3yvc4ZsvD/ZJ5g=="}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:30.850906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-d4435ef9-8667-4ad3-9a36-abac57270358 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Getting quotas for project 8e8481f1683045d4a63b3d33e0dab620. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:45:30.854903 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-d4435ef9-8667-4ad3-9a36-abac57270358 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Getting quotas for user 8e68f520aaff495abfb4b7a5271936e1 and project 8e8481f1683045d4a63b3d33e0dab620. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:45:30.880642 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-d4435ef9-8667-4ad3-9a36-abac57270358 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053970 Aug 22 05:45:30.881233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 371/725] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 22 05:45:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:45:31.571243 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d26bccdd-bb01-484a-9df2-7f7d442784be tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:31.573555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d26bccdd-bb01-484a-9df2-7f7d442784be tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:31.580271 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d26bccdd-bb01-484a-9df2-7f7d442784be tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:31.580746 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d26bccdd-bb01-484a-9df2-7f7d442784be tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:31.581169 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d26bccdd-bb01-484a-9df2-7f7d442784be tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:31.581852 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d26bccdd-bb01-484a-9df2-7f7d442784be tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:31.582691 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d26bccdd-bb01-484a-9df2-7f7d442784be tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:31.583070 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d26bccdd-bb01-484a-9df2-7f7d442784be tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:31.594314 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e2a15c4f-1be8-4630-a852-7b4536b95cfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:31.595305 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e2a15c4f-1be8-4630-a852-7b4536b95cfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:31.603103 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2a15c4f-1be8-4630-a852-7b4536b95cfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:31.603833 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2a15c4f-1be8-4630-a852-7b4536b95cfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:31.604293 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2a15c4f-1be8-4630-a852-7b4536b95cfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:31.605079 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2a15c4f-1be8-4630-a852-7b4536b95cfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:31.605594 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2a15c4f-1be8-4630-a852-7b4536b95cfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:31.606281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2a15c4f-1be8-4630-a852-7b4536b95cfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:31.616071 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d26bccdd-bb01-484a-9df2-7f7d442784be tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048723 Aug 22 05:45:31.616652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 355/726] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Aug 22 05:45:31 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:45:31.850320 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e2a15c4f-1be8-4630-a852-7b4536b95cfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:31.858255 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e2a15c4f-1be8-4630-a852-7b4536b95cfe tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1690 microversion: 2.1 time: 0.269121 Aug 22 05:45:31.858940 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 372/727] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:31 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1690 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:32.275347 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1845712672", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "629267ab-1398-436b-bf36-0ee4763d8e9a"}], "security_groups": [{"name": "tempest-securitygroup--842732199"}], "key_name": "tempest-keypair-1096199609", "user_data": "}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:32.382769 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] validate_networks() for [('629267ab-1398-436b-bf36-0ee4763d8e9a', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:45:32.629799 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-2d2b405e-1472-4a3e-a6a5-53da29f09655 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:32.632258 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-2d2b405e-1472-4a3e-a6a5-53da29f09655 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:32.639097 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2d2b405e-1472-4a3e-a6a5-53da29f09655 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:32.639607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2d2b405e-1472-4a3e-a6a5-53da29f09655 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:32.640048 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2d2b405e-1472-4a3e-a6a5-53da29f09655 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:32.640750 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2d2b405e-1472-4a3e-a6a5-53da29f09655 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:32.641200 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2d2b405e-1472-4a3e-a6a5-53da29f09655 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:32.642253 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2d2b405e-1472-4a3e-a6a5-53da29f09655 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:32.674580 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-2d2b405e-1472-4a3e-a6a5-53da29f09655 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049612 Aug 22 05:45:32.675167 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 373/728] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Aug 22 05:45:32 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:45:32.881482 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b06f9fc6-ed48-4e89-a63f-0a9e660fc492 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:32.882985 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b06f9fc6-ed48-4e89-a63f-0a9e660fc492 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:32.884478 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:45:32.885616 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:45:32.887342 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:45:32.888631 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:45:32.889257 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:45:32.889766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b06f9fc6-ed48-4e89-a63f-0a9e660fc492 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:32.890352 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b06f9fc6-ed48-4e89-a63f-0a9e660fc492 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:32.890836 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b06f9fc6-ed48-4e89-a63f-0a9e660fc492 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:32.892332 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b06f9fc6-ed48-4e89-a63f-0a9e660fc492 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:32.893082 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b06f9fc6-ed48-4e89-a63f-0a9e660fc492 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:32.894096 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b06f9fc6-ed48-4e89-a63f-0a9e660fc492 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:32.912989 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:32.914036 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:32.914644 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:32.915942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:32.916602 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:32.917219 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:32.941246 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Getting quotas for project 8e8481f1683045d4a63b3d33e0dab620. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:45:32.946385 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Getting quotas for user 8e68f520aaff495abfb4b7a5271936e1 and project 8e8481f1683045d4a63b3d33e0dab620. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:45:32.962126 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:45:32.965150 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:45:33.018900 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5827b263-82fe-489f-9002-5abc9f56932e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.747810 Aug 22 05:45:33.019769 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 356/729] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:45:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:45:33.031115 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-50c36a38-8c96-4b7e-907b-03995eeaa7fd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:33.031877 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-50c36a38-8c96-4b7e-907b-03995eeaa7fd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:33.272633 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-50c36a38-8c96-4b7e-907b-03995eeaa7fd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:33.280145 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-50c36a38-8c96-4b7e-907b-03995eeaa7fd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 200 len: 1238 microversion: 2.1 time: 0.253213 Aug 22 05:45:33.280827 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 357/730] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:33 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 1238 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:33.406440 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b06f9fc6-ed48-4e89-a63f-0a9e660fc492 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:33.416558 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b06f9fc6-ed48-4e89-a63f-0a9e660fc492 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1690 microversion: 2.1 time: 0.540130 Aug 22 05:45:33.417168 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 374/731] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:32 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1690 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:33.686573 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-cb5cec80-e88a-4a15-855d-6d38ab52ac59 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:33.697569 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-cb5cec80-e88a-4a15-855d-6d38ab52ac59 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:33.709732 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cb5cec80-e88a-4a15-855d-6d38ab52ac59 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:33.710201 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cb5cec80-e88a-4a15-855d-6d38ab52ac59 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:33.710666 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cb5cec80-e88a-4a15-855d-6d38ab52ac59 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:33.711369 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cb5cec80-e88a-4a15-855d-6d38ab52ac59 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:33.711860 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cb5cec80-e88a-4a15-855d-6d38ab52ac59 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:33.712280 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cb5cec80-e88a-4a15-855d-6d38ab52ac59 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:33.744426 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-cb5cec80-e88a-4a15-855d-6d38ab52ac59 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061812 Aug 22 05:45:33.744993 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 358/732] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Aug 22 05:45:33 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:33.810739 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e2169263-70b9-4bb8-a4ca-19d96c965ae1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:33.811285 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e2169263-70b9-4bb8-a4ca-19d96c965ae1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:33.817978 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2169263-70b9-4bb8-a4ca-19d96c965ae1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:33.819092 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2169263-70b9-4bb8-a4ca-19d96c965ae1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:33.819525 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2169263-70b9-4bb8-a4ca-19d96c965ae1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:33.820249 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2169263-70b9-4bb8-a4ca-19d96c965ae1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:33.820695 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2169263-70b9-4bb8-a4ca-19d96c965ae1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:33.821114 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2169263-70b9-4bb8-a4ca-19d96c965ae1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:33.846768 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e2169263-70b9-4bb8-a4ca-19d96c965ae1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Going to try to terminate instance {{(pid=132497) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:45:33.941473 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e2169263-70b9-4bb8-a4ca-19d96c965ae1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "DELETE /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 204 len: 0 microversion: 2.20 time: 0.133939 Aug 22 05:45:33.945521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 375/733] 10.222.0.18 () {60 vars in 1280 bytes} [Mon Aug 22 05:45:33 2022] DELETE /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 05:45:33.950897 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-566f19c0-7136-4a05-a962-c610d453fc24 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:33.952314 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-566f19c0-7136-4a05-a962-c610d453fc24 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:33.960596 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-566f19c0-7136-4a05-a962-c610d453fc24 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:33.961375 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-566f19c0-7136-4a05-a962-c610d453fc24 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:33.962162 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-566f19c0-7136-4a05-a962-c610d453fc24 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:33.963018 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-566f19c0-7136-4a05-a962-c610d453fc24 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:33.963710 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-566f19c0-7136-4a05-a962-c610d453fc24 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:33.964636 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-566f19c0-7136-4a05-a962-c610d453fc24 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:33.990199 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-65915b6f-a851-4d97-bb24-0c552f78deda req-e912dc69-0fa1-4a8f-895f-c3454c69783f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c93cef-e688-4d2c-ad3d-508c12c362f3", "name": "network-vif-deleted", "tag": "fb44f91d-f5a9-4ec3-a7db-e4802e8c7620"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:34.000245 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-65915b6f-a851-4d97-bb24-0c552f78deda req-e912dc69-0fa1-4a8f-895f-c3454c69783f service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:34.001193 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-65915b6f-a851-4d97-bb24-0c552f78deda req-e912dc69-0fa1-4a8f-895f-c3454c69783f service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:34.001837 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-65915b6f-a851-4d97-bb24-0c552f78deda req-e912dc69-0fa1-4a8f-895f-c3454c69783f service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:34.020695 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-65915b6f-a851-4d97-bb24-0c552f78deda req-e912dc69-0fa1-4a8f-895f-c3454c69783f service nova] Creating event network-vif-deleted:fb44f91d-f5a9-4ec3-a7db-e4802e8c7620 for instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 on hv-cinder-85391 Aug 22 05:45:34.026863 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-65915b6f-a851-4d97-bb24-0c552f78deda req-e912dc69-0fa1-4a8f-895f-c3454c69783f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041869 Aug 22 05:45:34.028037 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 376/734] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:45:34.115422 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-566f19c0-7136-4a05-a962-c610d453fc24 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:34.124252 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-566f19c0-7136-4a05-a962-c610d453fc24 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:34.126688 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-566f19c0-7136-4a05-a962-c610d453fc24 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:34.128109 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-566f19c0-7136-4a05-a962-c610d453fc24 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1722 microversion: 2.20 time: 0.181103 Aug 22 05:45:34.128675 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 359/735] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:45:33 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:45:34.302674 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-68c4f9db-6338-4460-a7cc-13be9c3130ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:34.303325 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-68c4f9db-6338-4460-a7cc-13be9c3130ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:34.310006 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-68c4f9db-6338-4460-a7cc-13be9c3130ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:34.310500 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-68c4f9db-6338-4460-a7cc-13be9c3130ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:34.310909 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-68c4f9db-6338-4460-a7cc-13be9c3130ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:34.311607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-68c4f9db-6338-4460-a7cc-13be9c3130ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:34.312098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-68c4f9db-6338-4460-a7cc-13be9c3130ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:34.312500 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-68c4f9db-6338-4460-a7cc-13be9c3130ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:34.383457 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-68c4f9db-6338-4460-a7cc-13be9c3130ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:34.391333 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-68c4f9db-6338-4460-a7cc-13be9c3130ef tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 200 len: 1298 microversion: 2.1 time: 0.093301 Aug 22 05:45:34.392035 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 377/736] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:34 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:34.438852 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6944d56b-00cc-42ea-86b3-08931563c737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:34.439536 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6944d56b-00cc-42ea-86b3-08931563c737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:34.445813 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6944d56b-00cc-42ea-86b3-08931563c737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:34.446283 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6944d56b-00cc-42ea-86b3-08931563c737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:34.446710 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6944d56b-00cc-42ea-86b3-08931563c737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:34.447425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6944d56b-00cc-42ea-86b3-08931563c737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:34.447896 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6944d56b-00cc-42ea-86b3-08931563c737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:34.448303 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6944d56b-00cc-42ea-86b3-08931563c737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:34.510024 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6944d56b-00cc-42ea-86b3-08931563c737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:34.518686 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6944d56b-00cc-42ea-86b3-08931563c737 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1622 microversion: 2.1 time: 0.083860 Aug 22 05:45:34.519274 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 360/737] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:34 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1622 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:35.152396 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-06b16405-9fe6-4da1-9eed-18406f4366b7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:35.153004 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-06b16405-9fe6-4da1-9eed-18406f4366b7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:35.160310 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06b16405-9fe6-4da1-9eed-18406f4366b7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:35.160790 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06b16405-9fe6-4da1-9eed-18406f4366b7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:35.161222 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06b16405-9fe6-4da1-9eed-18406f4366b7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:35.161908 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06b16405-9fe6-4da1-9eed-18406f4366b7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:35.162357 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06b16405-9fe6-4da1-9eed-18406f4366b7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:35.163197 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06b16405-9fe6-4da1-9eed-18406f4366b7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:35.387918 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-06b16405-9fe6-4da1-9eed-18406f4366b7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:35.396855 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-06b16405-9fe6-4da1-9eed-18406f4366b7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:35.398358 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-06b16405-9fe6-4da1-9eed-18406f4366b7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:35.399567 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-06b16405-9fe6-4da1-9eed-18406f4366b7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1722 microversion: 2.20 time: 0.251092 Aug 22 05:45:35.400151 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 378/738] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:45:35 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:45:35.412392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-13e0ebc5-013e-49d0-9941-ee71e525db0d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:35.413134 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-13e0ebc5-013e-49d0-9941-ee71e525db0d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:35.419899 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-13e0ebc5-013e-49d0-9941-ee71e525db0d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:35.420529 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-13e0ebc5-013e-49d0-9941-ee71e525db0d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:35.420880 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-13e0ebc5-013e-49d0-9941-ee71e525db0d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:35.421590 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-13e0ebc5-013e-49d0-9941-ee71e525db0d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:35.422192 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-13e0ebc5-013e-49d0-9941-ee71e525db0d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:35.422549 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-13e0ebc5-013e-49d0-9941-ee71e525db0d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:35.485255 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-13e0ebc5-013e-49d0-9941-ee71e525db0d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:35.493248 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-13e0ebc5-013e-49d0-9941-ee71e525db0d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 200 len: 1296 microversion: 2.1 time: 0.084721 Aug 22 05:45:35.493806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 361/739] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:35 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:35.539968 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ca0e6b62-40d3-4270-8d0f-0fba4c07f3f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:35.540693 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ca0e6b62-40d3-4270-8d0f-0fba4c07f3f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:35.547668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ca0e6b62-40d3-4270-8d0f-0fba4c07f3f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:35.548144 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ca0e6b62-40d3-4270-8d0f-0fba4c07f3f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:35.548742 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ca0e6b62-40d3-4270-8d0f-0fba4c07f3f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:35.549435 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ca0e6b62-40d3-4270-8d0f-0fba4c07f3f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:35.550067 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ca0e6b62-40d3-4270-8d0f-0fba4c07f3f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:35.550486 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ca0e6b62-40d3-4270-8d0f-0fba4c07f3f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:35.568736 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:45:35.584492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ca0e6b62-40d3-4270-8d0f-0fba4c07f3f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:35.584993 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ca0e6b62-40d3-4270-8d0f-0fba4c07f3f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:35.585420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ca0e6b62-40d3-4270-8d0f-0fba4c07f3f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:35.585860 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.objects.instance [None req-ca0e6b62-40d3-4270-8d0f-0fba4c07f3f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lazy-loading 'fault' on Instance uuid 38c93cef-e688-4d2c-ad3d-508c12c362f3 {{(pid=132497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:45:35.633025 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ca0e6b62-40d3-4270-8d0f-0fba4c07f3f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:35.640891 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ca0e6b62-40d3-4270-8d0f-0fba4c07f3f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 200 len: 1335 microversion: 2.1 time: 0.104768 Aug 22 05:45:35.641552 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 379/740] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:35 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 1335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:36.423318 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-868c7e79-5ff8-40f8-a934-0bf69c34e858 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:36.424921 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-868c7e79-5ff8-40f8-a934-0bf69c34e858 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:36.433085 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-868c7e79-5ff8-40f8-a934-0bf69c34e858 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:36.433964 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-868c7e79-5ff8-40f8-a934-0bf69c34e858 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:36.435327 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-868c7e79-5ff8-40f8-a934-0bf69c34e858 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:36.436903 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-868c7e79-5ff8-40f8-a934-0bf69c34e858 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:36.437576 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-868c7e79-5ff8-40f8-a934-0bf69c34e858 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:36.438420 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-868c7e79-5ff8-40f8-a934-0bf69c34e858 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:36.514048 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-111537f4-92a6-4101-9a90-0da7728e5ee6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:36.515290 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-111537f4-92a6-4101-9a90-0da7728e5ee6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:36.526604 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-111537f4-92a6-4101-9a90-0da7728e5ee6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:36.527376 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-111537f4-92a6-4101-9a90-0da7728e5ee6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:36.527992 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-111537f4-92a6-4101-9a90-0da7728e5ee6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:36.528888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-111537f4-92a6-4101-9a90-0da7728e5ee6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:36.529499 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-111537f4-92a6-4101-9a90-0da7728e5ee6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:36.530069 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-111537f4-92a6-4101-9a90-0da7728e5ee6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:36.544000 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-868c7e79-5ff8-40f8-a934-0bf69c34e858 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:36.561903 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-868c7e79-5ff8-40f8-a934-0bf69c34e858 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:36.564131 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-868c7e79-5ff8-40f8-a934-0bf69c34e858 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:36.568919 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-868c7e79-5ff8-40f8-a934-0bf69c34e858 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 200 len: 1655 microversion: 2.20 time: 0.150122 Aug 22 05:45:36.570320 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 362/741] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:45:36 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 1655 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:45:36.663607 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a2547fd2-2e36-401a-9f95-cd5047dc0751 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:36.664575 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a2547fd2-2e36-401a-9f95-cd5047dc0751 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 38c93cef-e688-4d2c-ad3d-508c12c362f3] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:36.672155 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2547fd2-2e36-401a-9f95-cd5047dc0751 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:36.673079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2547fd2-2e36-401a-9f95-cd5047dc0751 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:36.673819 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2547fd2-2e36-401a-9f95-cd5047dc0751 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:36.674777 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2547fd2-2e36-401a-9f95-cd5047dc0751 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:36.675437 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2547fd2-2e36-401a-9f95-cd5047dc0751 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:36.676228 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2547fd2-2e36-401a-9f95-cd5047dc0751 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:36.691920 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-a2547fd2-2e36-401a-9f95-cd5047dc0751 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] HTTP exception thrown: Instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 could not be found. Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a2547fd2-2e36-401a-9f95-cd5047dc0751 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Request method failure captured: Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 HTTP/1.1 Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxZJ7BdnzK-u4DKWWTr2FX2u5pwmnE2XjOu8umL3m5FZVx9vs8-L9guf58r47bG_oFQDAwD733BJkilMph8nunSZNTzBoLdMj0DH2XIL-y0pAdClU7WOEjgndU2mtYSxv2QT6l_KuebCiUPUyx_PUd635STXp1Lia-VSwvM8EBbSje4 Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 8cadb48afce14e758bfe62771530527a Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1818501039 Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:45:36.693846 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:45:36.695472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8cadb48afce14e758bfe62771530527a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cadb48afce14e758bfe62771530527a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cadb48afce14e758bfe62771530527a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8cadb48afce14e758bfe62771530527a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:45:36.695472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1818501039 Aug 22 05:45:36.695472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 8cadb48afce14e758bfe62771530527a Aug 22 05:45:36.695472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1818501039 Aug 22 05:45:36.695472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-ServerRescueNegativeTestJSON-1818501039-project Aug 22 05:45:36.695472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:45:36.695472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:45:36.695472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 9643b0f10e8345889c181efbb1978237 Aug 22 05:45:36.695472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1818501039-project Aug 22 05:45:36.695472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:45:36.695472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 could not be found. Aug 22 05:45:36.695472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '38c93cef-e688-4d2c-ad3d-508c12c362f3'} Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 could not be found. Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:45:36.696417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 could not be found. Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 could not be found. Aug 22 05:45:36.697904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:36.699179 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a2547fd2-2e36-401a-9f95-cd5047dc0751 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Returning 404 to user: Instance 38c93cef-e688-4d2c-ad3d-508c12c362f3 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:45:36.699179 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a2547fd2-2e36-401a-9f95-cd5047dc0751 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3" status: 404 len: 111 microversion: 2.1 time: 0.036779 Aug 22 05:45:36.699179 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 363/742] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:36 2022] GET /compute/v2.1/servers/38c93cef-e688-4d2c-ad3d-508c12c362f3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:45:36.703943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fe9b4388-bec4-4e69-856f-53516baaa364 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '.version_select at 0x7f0b3de5f4c0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:36.740073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fe9b4388-bec4-4e69-856f-53516baaa364 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988694950" status: 202 len: 0 microversion: 2.1 time: 0.039791 Aug 22 05:45:36.744960 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 364/743] 10.222.0.18 () {58 vars in 1221 bytes} [Mon Aug 22 05:45:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988694950 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:45:36.802854 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-111537f4-92a6-4101-9a90-0da7728e5ee6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:36.819803 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-111537f4-92a6-4101-9a90-0da7728e5ee6 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 200 len: 1363 microversion: 2.1 time: 0.309392 Aug 22 05:45:36.820390 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 380/744] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:36 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:45:36.942732 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-566c4698-c3a7-40c0-a150-31611b42c09b req-d29ff3e9-a39c-4a1d-b671-c40d25598e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb", "name": "network-vif-deleted", "tag": "4c76faf8-d367-4a1e-9d06-cc6e666badde"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:36.959682 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-566c4698-c3a7-40c0-a150-31611b42c09b req-d29ff3e9-a39c-4a1d-b671-c40d25598e79 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:36.960514 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-566c4698-c3a7-40c0-a150-31611b42c09b req-d29ff3e9-a39c-4a1d-b671-c40d25598e79 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:36.961107 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-566c4698-c3a7-40c0-a150-31611b42c09b req-d29ff3e9-a39c-4a1d-b671-c40d25598e79 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:36.978061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-566c4698-c3a7-40c0-a150-31611b42c09b req-d29ff3e9-a39c-4a1d-b671-c40d25598e79 service nova] Creating event network-vif-deleted:4c76faf8-d367-4a1e-9d06-cc6e666badde for instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb on hv-cinder-85391 Aug 22 05:45:36.986314 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-566c4698-c3a7-40c0-a150-31611b42c09b req-d29ff3e9-a39c-4a1d-b671-c40d25598e79 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193587 Aug 22 05:45:36.997833 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 365/745] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:45:37.429295 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-36ee37e2-423a-436e-8046-4ba906a62581 req-45b2b56f-2838-45bf-b950-6854fd83c634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75fe69ea-b7a4-42f9-b222-4eea23123c62", "tag": "83c31f1b-d8da-4975-a21b-2e8a4c789571"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:37.447905 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-36ee37e2-423a-436e-8046-4ba906a62581 req-45b2b56f-2838-45bf-b950-6854fd83c634 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:37.448654 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-36ee37e2-423a-436e-8046-4ba906a62581 req-45b2b56f-2838-45bf-b950-6854fd83c634 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:37.449272 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-36ee37e2-423a-436e-8046-4ba906a62581 req-45b2b56f-2838-45bf-b950-6854fd83c634 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:37.470973 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-36ee37e2-423a-436e-8046-4ba906a62581 req-45b2b56f-2838-45bf-b950-6854fd83c634 service nova] Creating event network-changed:83c31f1b-d8da-4975-a21b-2e8a4c789571 for instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 on hv-cinder-85391 Aug 22 05:45:37.477876 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-36ee37e2-423a-436e-8046-4ba906a62581 req-45b2b56f-2838-45bf-b950-6854fd83c634 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053385 Aug 22 05:45:37.479153 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 381/746] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:45:37.594204 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b96c95d2-5a05-4d89-930a-241a0e64e758 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:37.595067 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b96c95d2-5a05-4d89-930a-241a0e64e758 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:37.601844 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b96c95d2-5a05-4d89-930a-241a0e64e758 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:37.602816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b96c95d2-5a05-4d89-930a-241a0e64e758 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:37.603397 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b96c95d2-5a05-4d89-930a-241a0e64e758 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:37.604268 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b96c95d2-5a05-4d89-930a-241a0e64e758 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:37.605278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b96c95d2-5a05-4d89-930a-241a0e64e758 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:37.606099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b96c95d2-5a05-4d89-930a-241a0e64e758 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:37.625914 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-b96c95d2-5a05-4d89-930a-241a0e64e758 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] HTTP exception thrown: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b96c95d2-5a05-4d89-930a-241a0e64e758 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Request method failure captured: Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb HTTP/1.1 Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxbJlDK1uY-9wqLqihMbwRqesNGVCWX4DheM5VLJrOjTR46vBOGSHxQrZllJKbAVqUcrCrtjQXWEHIO6-XCvfuvjcl9yH54l2HLzoxuiB6jt_hZqeF-IoIpGa8umora8AXWsLgKIbyBUgggic1ZEp_39A7UCBRbZ1VYQo-hgHjfu66c Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: e27e3216211942959311372c2d078202 Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:45:37.628230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:45:37.629647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e27e3216211942959311372c2d078202", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e27e3216211942959311372c2d078202"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e27e3216211942959311372c2d078202"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e27e3216211942959311372c2d078202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:45:37.629647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:45:37.629647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: e27e3216211942959311372c2d078202 Aug 22 05:45:37.629647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:45:37.629647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeShelveTestJSON-2055896554-project Aug 22 05:45:37.629647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:45:37.629647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:45:37.629647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 2864050fd1a64646a8760f0172be8f4a Aug 22 05:45:37.629647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2055896554-project Aug 22 05:45:37.629647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:45:37.629647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. Aug 22 05:45:37.629647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb'} Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:45:37.630436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. Aug 22 05:45:37.631701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:37.632862 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b96c95d2-5a05-4d89-930a-241a0e64e758 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Returning 404 to user: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:45:37.632862 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b96c95d2-5a05-4d89-930a-241a0e64e758 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 404 len: 111 microversion: 2.20 time: 0.040767 Aug 22 05:45:37.634615 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 366/747] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:45:37 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 05:45:37.640019 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-393063fe-9bd5-47ba-bebf-02c6f843f4e8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '.version_select at 0x7f0b3e02fb80>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:37.676431 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-393063fe-9bd5-47ba-bebf-02c6f843f4e8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-350476886" status: 204 len: 0 microversion: 2.20 time: 0.040586 Aug 22 05:45:37.677399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 382/748] 10.222.0.18 () {60 vars in 1259 bytes} [Mon Aug 22 05:45:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-350476886 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 05:45:37.841566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-793eea68-08b2-4b15-9254-2c859309d51f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:37.842490 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-793eea68-08b2-4b15-9254-2c859309d51f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:37.848878 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-793eea68-08b2-4b15-9254-2c859309d51f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:37.849370 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-793eea68-08b2-4b15-9254-2c859309d51f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:37.850039 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-793eea68-08b2-4b15-9254-2c859309d51f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:37.850936 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-793eea68-08b2-4b15-9254-2c859309d51f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:37.851402 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-793eea68-08b2-4b15-9254-2c859309d51f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:37.852072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-793eea68-08b2-4b15-9254-2c859309d51f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:38.086527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-793eea68-08b2-4b15-9254-2c859309d51f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:38.095677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-793eea68-08b2-4b15-9254-2c859309d51f tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 200 len: 1363 microversion: 2.1 time: 0.258178 Aug 22 05:45:38.096804 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 367/749] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:37 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:38.549994 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8cf43935-013d-4315-bb11-733f733bbb93 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Action: 'create', calling method: .version_select at 0x7f0b3df3d820>, body: {"keypair": {"name": "tempest-keypair-1168388050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLYthH9aohWJqxZwH6LCktVGcMA0eyT/9wnd8QvAR9Y4dCw9OIIgttO7CEwWL+vfJPFpXfb2taHIoDRrqjE6YjIkSa9V1awNomKxJJwUC7+m3RQK+Qn3xKiYa7YlLONOA=="}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:38.567283 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-8cf43935-013d-4315-bb11-733f733bbb93 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Getting quotas for project e27e3216211942959311372c2d078202. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:45:38.571668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-8cf43935-013d-4315-bb11-733f733bbb93 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Getting quotas for user 2864050fd1a64646a8760f0172be8f4a and project e27e3216211942959311372c2d078202. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:45:38.597988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8cf43935-013d-4315-bb11-733f733bbb93 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052086 Aug 22 05:45:38.598591 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 383/750] 10.222.0.18 () {62 vars in 1200 bytes} [Mon Aug 22 05:45:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 05:45:39.117424 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7e54ed57-7acc-470b-803d-7366d81f9b84 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:39.117970 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7e54ed57-7acc-470b-803d-7366d81f9b84 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:39.124726 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e54ed57-7acc-470b-803d-7366d81f9b84 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:39.126459 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e54ed57-7acc-470b-803d-7366d81f9b84 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:39.126939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e54ed57-7acc-470b-803d-7366d81f9b84 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:39.127853 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e54ed57-7acc-470b-803d-7366d81f9b84 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:39.128304 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e54ed57-7acc-470b-803d-7366d81f9b84 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:39.128722 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7e54ed57-7acc-470b-803d-7366d81f9b84 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:39.133304 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:45:39.326225 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7e54ed57-7acc-470b-803d-7366d81f9b84 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:39.335108 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7e54ed57-7acc-470b-803d-7366d81f9b84 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 200 len: 1363 microversion: 2.1 time: 0.221847 Aug 22 05:45:39.335743 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 368/751] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:39 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:45:39.920285 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1355842738", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ca0f691b-0b03-4da0-a433-7d2fc12c78d9"}], "security_groups": [{"name": "tempest-securitygroup--167295707"}], "key_name": "tempest-keypair-1168388050", "user_data": "}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:39.990425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9fb3fdd8-6967-4534-bccd-7c7e4d5d5d42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:39.990916 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9fb3fdd8-6967-4534-bccd-7c7e4d5d5d42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:39.997052 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fb3fdd8-6967-4534-bccd-7c7e4d5d5d42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:39.997537 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fb3fdd8-6967-4534-bccd-7c7e4d5d5d42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:39.997954 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fb3fdd8-6967-4534-bccd-7c7e4d5d5d42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:39.998629 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fb3fdd8-6967-4534-bccd-7c7e4d5d5d42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:39.999053 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fb3fdd8-6967-4534-bccd-7c7e4d5d5d42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:39.999507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fb3fdd8-6967-4534-bccd-7c7e4d5d5d42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:40.027108 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9fb3fdd8-6967-4534-bccd-7c7e4d5d5d42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:45:40.078774 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.network.neutron [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] validate_networks() for [('ca0f691b-0b03-4da0-a433-7d2fc12c78d9', None, None, None, None, None)] {{(pid=132497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:45:40.113130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9fb3fdd8-6967-4534-bccd-7c7e4d5d5d42 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "DELETE /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 204 len: 0 microversion: 2.1 time: 0.126174 Aug 22 05:45:40.113801 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 369/752] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:45:39 2022] DELETE /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 05:45:40.122561 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6c3b7523-9b12-4153-bdad-9832f851f408 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:40.123395 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6c3b7523-9b12-4153-bdad-9832f851f408 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:40.130859 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c3b7523-9b12-4153-bdad-9832f851f408 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:40.131337 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c3b7523-9b12-4153-bdad-9832f851f408 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:40.131874 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c3b7523-9b12-4153-bdad-9832f851f408 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:40.132573 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c3b7523-9b12-4153-bdad-9832f851f408 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:40.132996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c3b7523-9b12-4153-bdad-9832f851f408 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:40.133407 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6c3b7523-9b12-4153-bdad-9832f851f408 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:40.627270 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6c3b7523-9b12-4153-bdad-9832f851f408 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:40.635426 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6c3b7523-9b12-4153-bdad-9832f851f408 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1506 microversion: 2.1 time: 0.517051 Aug 22 05:45:40.636284 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 370/753] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:40 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1506 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:40.641028 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ce305fa5-61e1-497b-83c7-a74921692fcc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:40.641798 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ce305fa5-61e1-497b-83c7-a74921692fcc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:40.653133 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ce305fa5-61e1-497b-83c7-a74921692fcc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:40.653619 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ce305fa5-61e1-497b-83c7-a74921692fcc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:40.654067 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ce305fa5-61e1-497b-83c7-a74921692fcc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:40.654752 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ce305fa5-61e1-497b-83c7-a74921692fcc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:40.655201 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ce305fa5-61e1-497b-83c7-a74921692fcc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:40.655652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ce305fa5-61e1-497b-83c7-a74921692fcc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:40.991723 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ce305fa5-61e1-497b-83c7-a74921692fcc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:41.000016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ce305fa5-61e1-497b-83c7-a74921692fcc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 200 len: 1363 microversion: 2.1 time: 0.362726 Aug 22 05:45:41.003610 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 371/754] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:40 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 1363 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:41.124922 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Flavor limits 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:45:41.126579 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Image limits 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:45:41.127274 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Flavor pref 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:45:41.127871 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Image pref 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:45:41.129134 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:45:41.146400 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:41.149366 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:41.150015 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:41.151771 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:41.152243 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:41.154122 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:41.166521 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-7045cc09-840a-4151-bf51-718cae8c75b5 req-bbdb7ef3-904d-483e-9b4b-364306d6017e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b0897c-3b82-4926-909a-2c34fbcd2a1a", "name": "network-vif-deleted", "tag": "c621e300-a2f5-4edd-a7c7-b4bf9b5a2cd7"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:41.183709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Getting quotas for project e27e3216211942959311372c2d078202. Resources: {'cores', 'instances', 'ram'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:45:41.188648 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Getting quotas for user 2864050fd1a64646a8760f0172be8f4a and project e27e3216211942959311372c2d078202. Resources: {'cores', 'instances', 'ram'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:45:41.196291 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7045cc09-840a-4151-bf51-718cae8c75b5 req-bbdb7ef3-904d-483e-9b4b-364306d6017e service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:41.196945 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7045cc09-840a-4151-bf51-718cae8c75b5 req-bbdb7ef3-904d-483e-9b4b-364306d6017e service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:41.197395 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7045cc09-840a-4151-bf51-718cae8c75b5 req-bbdb7ef3-904d-483e-9b4b-364306d6017e service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:41.200330 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Going to run 1 instances... {{(pid=132497) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:45:41.202966 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:45:41.228472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-7045cc09-840a-4151-bf51-718cae8c75b5 req-bbdb7ef3-904d-483e-9b4b-364306d6017e service nova] Creating event network-vif-deleted:c621e300-a2f5-4edd-a7c7-b4bf9b5a2cd7 for instance 02b0897c-3b82-4926-909a-2c34fbcd2a1a on hv-cinder-85391 Aug 22 05:45:41.233908 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-7045cc09-840a-4151-bf51-718cae8c75b5 req-bbdb7ef3-904d-483e-9b4b-364306d6017e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072023 Aug 22 05:45:41.235309 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 372/755] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:45:41.274758 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-2ea2819f-ddcb-4e21-8f40-8adf59c1fb9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.359462 Aug 22 05:45:41.275601 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 384/756] 10.222.0.18 () {62 vars in 1188 bytes} [Mon Aug 22 05:45:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 22 05:45:41.289087 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5567d97f-7d5d-4a09-af3d-7bf748180d86 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:41.289559 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5567d97f-7d5d-4a09-af3d-7bf748180d86 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:41.364155 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5567d97f-7d5d-4a09-af3d-7bf748180d86 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:41.375667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5567d97f-7d5d-4a09-af3d-7bf748180d86 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:41.377768 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5567d97f-7d5d-4a09-af3d-7bf748180d86 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:41.378881 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5567d97f-7d5d-4a09-af3d-7bf748180d86 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1282 microversion: 2.20 time: 0.095523 Aug 22 05:45:41.379640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 373/757] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:45:41 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:45:41.656034 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5928e675-5752-4f78-8a77-a464f070a709 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:41.657128 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5928e675-5752-4f78-8a77-a464f070a709 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:41.664659 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5928e675-5752-4f78-8a77-a464f070a709 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:41.665155 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5928e675-5752-4f78-8a77-a464f070a709 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:41.665718 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5928e675-5752-4f78-8a77-a464f070a709 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:41.666889 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5928e675-5752-4f78-8a77-a464f070a709 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:41.667483 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5928e675-5752-4f78-8a77-a464f070a709 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:41.667954 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5928e675-5752-4f78-8a77-a464f070a709 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:41.706342 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5928e675-5752-4f78-8a77-a464f070a709 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:41.706807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5928e675-5752-4f78-8a77-a464f070a709 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:41.707961 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5928e675-5752-4f78-8a77-a464f070a709 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:41.708435 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.objects.instance [None req-5928e675-5752-4f78-8a77-a464f070a709 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lazy-loading 'fault' on Instance uuid 02b0897c-3b82-4926-909a-2c34fbcd2a1a {{(pid=132497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:45:41.754412 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5928e675-5752-4f78-8a77-a464f070a709 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:41.762421 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5928e675-5752-4f78-8a77-a464f070a709 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 200 len: 1311 microversion: 2.1 time: 0.110120 Aug 22 05:45:41.762959 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 385/758] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:41 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 1311 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:45:42.021163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fc57a9f6-dd24-4cf9-bbfa-def27824bb76 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:42.021699 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fc57a9f6-dd24-4cf9-bbfa-def27824bb76 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:42.028300 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc57a9f6-dd24-4cf9-bbfa-def27824bb76 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:42.028783 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc57a9f6-dd24-4cf9-bbfa-def27824bb76 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:42.029224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc57a9f6-dd24-4cf9-bbfa-def27824bb76 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:42.029916 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc57a9f6-dd24-4cf9-bbfa-def27824bb76 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:42.030380 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc57a9f6-dd24-4cf9-bbfa-def27824bb76 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:42.030799 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc57a9f6-dd24-4cf9-bbfa-def27824bb76 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:42.166258 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fc57a9f6-dd24-4cf9-bbfa-def27824bb76 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:42.176130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fc57a9f6-dd24-4cf9-bbfa-def27824bb76 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 200 len: 1363 microversion: 2.1 time: 0.159074 Aug 22 05:45:42.176736 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 374/759] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:42 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:42.403054 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-547fd7ce-d57c-4854-bf4a-4f2e50c94f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:42.404357 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-547fd7ce-d57c-4854-bf4a-4f2e50c94f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:42.406347 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:45:42.412765 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-547fd7ce-d57c-4854-bf4a-4f2e50c94f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:42.413469 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-547fd7ce-d57c-4854-bf4a-4f2e50c94f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:42.414093 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-547fd7ce-d57c-4854-bf4a-4f2e50c94f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:42.414781 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-547fd7ce-d57c-4854-bf4a-4f2e50c94f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:42.415395 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-547fd7ce-d57c-4854-bf4a-4f2e50c94f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:42.415841 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-547fd7ce-d57c-4854-bf4a-4f2e50c94f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:42.491233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-547fd7ce-d57c-4854-bf4a-4f2e50c94f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:42.499812 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-547fd7ce-d57c-4854-bf4a-4f2e50c94f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:42.501955 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-547fd7ce-d57c-4854-bf4a-4f2e50c94f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:42.503043 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-547fd7ce-d57c-4854-bf4a-4f2e50c94f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1352 microversion: 2.20 time: 0.104211 Aug 22 05:45:42.503608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 386/760] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:45:42 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:45:42.785798 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a67516bc-a2d1-4044-b389-4aa49158cf8b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:42.786463 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a67516bc-a2d1-4044-b389-4aa49158cf8b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: 02b0897c-3b82-4926-909a-2c34fbcd2a1a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:42.792554 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a67516bc-a2d1-4044-b389-4aa49158cf8b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:42.793042 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a67516bc-a2d1-4044-b389-4aa49158cf8b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:42.793477 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a67516bc-a2d1-4044-b389-4aa49158cf8b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:42.794175 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a67516bc-a2d1-4044-b389-4aa49158cf8b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:42.794599 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a67516bc-a2d1-4044-b389-4aa49158cf8b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:42.795052 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a67516bc-a2d1-4044-b389-4aa49158cf8b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:42.808848 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-a67516bc-a2d1-4044-b389-4aa49158cf8b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] HTTP exception thrown: Instance 02b0897c-3b82-4926-909a-2c34fbcd2a1a could not be found. Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a67516bc-a2d1-4044-b389-4aa49158cf8b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Request method failure captured: Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a HTTP/1.1 Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxZJ7BdnzK-u4DKWWTr2FX2u5pwmnE2XjOu8umL3m5FZVx9vs8-L9guf58r47bG_oFQDAwD733BJkilMph8nunSZNTzBoLdMj0DH2XIL-y0pAdClU7WOEjgndU2mtYSxv2QT6l_KuebCiUPUyx_PUd635STXp1Lia-VSwvM8EBbSje4 Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 8cadb48afce14e758bfe62771530527a Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1818501039 Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:45:42.810696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:45:42.812736 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8cadb48afce14e758bfe62771530527a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cadb48afce14e758bfe62771530527a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cadb48afce14e758bfe62771530527a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8cadb48afce14e758bfe62771530527a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:45:42.812736 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1818501039 Aug 22 05:45:42.812736 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 8cadb48afce14e758bfe62771530527a Aug 22 05:45:42.812736 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1818501039 Aug 22 05:45:42.812736 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-ServerRescueNegativeTestJSON-1818501039-project Aug 22 05:45:42.812736 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:45:42.812736 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:45:42.812736 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 9643b0f10e8345889c181efbb1978237 Aug 22 05:45:42.812736 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1818501039-project Aug 22 05:45:42.812736 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:45:42.812736 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 02b0897c-3b82-4926-909a-2c34fbcd2a1a could not be found. Aug 22 05:45:42.812736 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '02b0897c-3b82-4926-909a-2c34fbcd2a1a'} Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b0897c-3b82-4926-909a-2c34fbcd2a1a could not be found. Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:45:42.813939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b0897c-3b82-4926-909a-2c34fbcd2a1a could not be found. Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b0897c-3b82-4926-909a-2c34fbcd2a1a could not be found. Aug 22 05:45:42.815165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:45:42.816979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a67516bc-a2d1-4044-b389-4aa49158cf8b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Returning 404 to user: Instance 02b0897c-3b82-4926-909a-2c34fbcd2a1a could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:45:42.816979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a67516bc-a2d1-4044-b389-4aa49158cf8b tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a" status: 404 len: 111 microversion: 2.1 time: 0.030454 Aug 22 05:45:42.816979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 375/761] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:42 2022] GET /compute/v2.1/servers/02b0897c-3b82-4926-909a-2c34fbcd2a1a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:45:42.822592 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-173e6d74-3394-44cf-bf60-1e518e408807 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:42.823093 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-173e6d74-3394-44cf-bf60-1e518e408807 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:42.831339 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-173e6d74-3394-44cf-bf60-1e518e408807 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:42.831876 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-173e6d74-3394-44cf-bf60-1e518e408807 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:42.832312 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-173e6d74-3394-44cf-bf60-1e518e408807 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:42.833014 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-173e6d74-3394-44cf-bf60-1e518e408807 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:42.833465 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-173e6d74-3394-44cf-bf60-1e518e408807 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:42.833887 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-173e6d74-3394-44cf-bf60-1e518e408807 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:42.860183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-173e6d74-3394-44cf-bf60-1e518e408807 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Going to try to terminate instance {{(pid=132497) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:45:42.943677 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-173e6d74-3394-44cf-bf60-1e518e408807 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 204 len: 0 microversion: 2.1 time: 0.124584 Aug 22 05:45:42.944559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 387/762] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:45:42 2022] DELETE /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:45:42.952274 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-332302c3-3bbe-4300-a4a2-7bc72b3093bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:42.953003 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-332302c3-3bbe-4300-a4a2-7bc72b3093bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:42.955262 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:45:42.960637 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-332302c3-3bbe-4300-a4a2-7bc72b3093bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:42.961187 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-332302c3-3bbe-4300-a4a2-7bc72b3093bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:42.961699 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-332302c3-3bbe-4300-a4a2-7bc72b3093bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:42.962469 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-332302c3-3bbe-4300-a4a2-7bc72b3093bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:42.962973 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-332302c3-3bbe-4300-a4a2-7bc72b3093bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:42.963469 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-332302c3-3bbe-4300-a4a2-7bc72b3093bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:43.123152 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-332302c3-3bbe-4300-a4a2-7bc72b3093bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:43.132954 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-332302c3-3bbe-4300-a4a2-7bc72b3093bb tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.184459 Aug 22 05:45:43.133538 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 376/763] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:42 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:43.205748 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-39ab3e81-8f2c-49be-b659-cdf968abfbea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:43.206661 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-39ab3e81-8f2c-49be-b659-cdf968abfbea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:43.213562 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-39ab3e81-8f2c-49be-b659-cdf968abfbea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:43.213813 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-39ab3e81-8f2c-49be-b659-cdf968abfbea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:43.214645 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-39ab3e81-8f2c-49be-b659-cdf968abfbea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:43.215916 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-39ab3e81-8f2c-49be-b659-cdf968abfbea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:43.215916 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-39ab3e81-8f2c-49be-b659-cdf968abfbea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:43.216551 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-39ab3e81-8f2c-49be-b659-cdf968abfbea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:43.266942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-7fba6414-b215-4061-b3aa-6291feaacf65 req-f9ea52be-0f93-46f5-a47b-c1a38399fa6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75fe69ea-b7a4-42f9-b222-4eea23123c62", "name": "network-vif-plugged", "status": "completed", "tag": "83c31f1b-d8da-4975-a21b-2e8a4c789571"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:43.281389 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7fba6414-b215-4061-b3aa-6291feaacf65 req-f9ea52be-0f93-46f5-a47b-c1a38399fa6d service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:43.282185 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7fba6414-b215-4061-b3aa-6291feaacf65 req-f9ea52be-0f93-46f5-a47b-c1a38399fa6d service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:43.282769 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7fba6414-b215-4061-b3aa-6291feaacf65 req-f9ea52be-0f93-46f5-a47b-c1a38399fa6d service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:43.299099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-7fba6414-b215-4061-b3aa-6291feaacf65 req-f9ea52be-0f93-46f5-a47b-c1a38399fa6d service nova] Creating event network-vif-plugged:83c31f1b-d8da-4975-a21b-2e8a4c789571 for instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 on hv-cinder-85391 Aug 22 05:45:43.305125 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-7fba6414-b215-4061-b3aa-6291feaacf65 req-f9ea52be-0f93-46f5-a47b-c1a38399fa6d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044319 Aug 22 05:45:43.306067 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 377/764] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:45:43.375150 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-39ab3e81-8f2c-49be-b659-cdf968abfbea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:43.383370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-39ab3e81-8f2c-49be-b659-cdf968abfbea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 200 len: 1363 microversion: 2.1 time: 0.182584 Aug 22 05:45:43.383969 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 388/765] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:43 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:43.527156 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-15cd043f-1b70-4e06-bd49-712eddc7182a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:43.527893 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-15cd043f-1b70-4e06-bd49-712eddc7182a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:43.534936 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-15cd043f-1b70-4e06-bd49-712eddc7182a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:43.535418 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-15cd043f-1b70-4e06-bd49-712eddc7182a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:43.535886 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-15cd043f-1b70-4e06-bd49-712eddc7182a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:43.536577 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-15cd043f-1b70-4e06-bd49-712eddc7182a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:43.537027 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-15cd043f-1b70-4e06-bd49-712eddc7182a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:43.537449 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-15cd043f-1b70-4e06-bd49-712eddc7182a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:43.673616 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-15cd043f-1b70-4e06-bd49-712eddc7182a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:43.681983 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-15cd043f-1b70-4e06-bd49-712eddc7182a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:43.683490 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-15cd043f-1b70-4e06-bd49-712eddc7182a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:43.684706 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-15cd043f-1b70-4e06-bd49-712eddc7182a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1407 microversion: 2.20 time: 0.161903 Aug 22 05:45:43.685267 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 378/766] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:45:43 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:45:44.157250 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f21b18fa-c143-408e-a852-1db3404bafbd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:44.157829 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f21b18fa-c143-408e-a852-1db3404bafbd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:44.164871 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f21b18fa-c143-408e-a852-1db3404bafbd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:44.165351 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f21b18fa-c143-408e-a852-1db3404bafbd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:44.165805 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f21b18fa-c143-408e-a852-1db3404bafbd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:44.166487 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f21b18fa-c143-408e-a852-1db3404bafbd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:44.166935 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f21b18fa-c143-408e-a852-1db3404bafbd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:44.167353 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f21b18fa-c143-408e-a852-1db3404bafbd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:44.303201 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-f21b18fa-c143-408e-a852-1db3404bafbd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:44.314785 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f21b18fa-c143-408e-a852-1db3404bafbd tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.162489 Aug 22 05:45:44.315346 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 389/767] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:44 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:44.406802 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ca18f0d5-4e9d-4a0f-b6df-7b48bd916b7e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:44.407568 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ca18f0d5-4e9d-4a0f-b6df-7b48bd916b7e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:44.414557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ca18f0d5-4e9d-4a0f-b6df-7b48bd916b7e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:44.415041 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ca18f0d5-4e9d-4a0f-b6df-7b48bd916b7e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:44.415473 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ca18f0d5-4e9d-4a0f-b6df-7b48bd916b7e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:44.416199 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ca18f0d5-4e9d-4a0f-b6df-7b48bd916b7e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:44.416651 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ca18f0d5-4e9d-4a0f-b6df-7b48bd916b7e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:44.417071 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ca18f0d5-4e9d-4a0f-b6df-7b48bd916b7e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:44.559441 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ca18f0d5-4e9d-4a0f-b6df-7b48bd916b7e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:44.567701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ca18f0d5-4e9d-4a0f-b6df-7b48bd916b7e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 200 len: 1363 microversion: 2.1 time: 0.166261 Aug 22 05:45:44.568269 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 379/768] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:44 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:44.711758 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5ecf1142-3f9f-4670-8464-5cba69f3f7cb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:44.712607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5ecf1142-3f9f-4670-8464-5cba69f3f7cb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:44.723244 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5ecf1142-3f9f-4670-8464-5cba69f3f7cb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:44.724056 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5ecf1142-3f9f-4670-8464-5cba69f3f7cb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:44.724762 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5ecf1142-3f9f-4670-8464-5cba69f3f7cb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:44.725877 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5ecf1142-3f9f-4670-8464-5cba69f3f7cb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:44.726611 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5ecf1142-3f9f-4670-8464-5cba69f3f7cb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:44.727290 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5ecf1142-3f9f-4670-8464-5cba69f3f7cb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:44.869762 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5ecf1142-3f9f-4670-8464-5cba69f3f7cb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:44.879540 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5ecf1142-3f9f-4670-8464-5cba69f3f7cb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:44.881581 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5ecf1142-3f9f-4670-8464-5cba69f3f7cb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:44.882954 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5ecf1142-3f9f-4670-8464-5cba69f3f7cb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1407 microversion: 2.20 time: 0.177935 Aug 22 05:45:44.899092 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 390/769] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:45:44 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:45:45.336000 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e580dcee-36f0-4883-8e52-54d336583fab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:45.336610 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e580dcee-36f0-4883-8e52-54d336583fab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:45.343034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e580dcee-36f0-4883-8e52-54d336583fab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:45.343958 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e580dcee-36f0-4883-8e52-54d336583fab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:45.344480 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e580dcee-36f0-4883-8e52-54d336583fab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:45.345487 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e580dcee-36f0-4883-8e52-54d336583fab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:45.345883 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e580dcee-36f0-4883-8e52-54d336583fab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:45.346384 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e580dcee-36f0-4883-8e52-54d336583fab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:45.384234 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-ab44a64a-e105-4da2-b6a2-9adeef7d9d96 req-80c34d36-795c-42f8-be58-7528a10b963e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d64c75c4-9ba2-408f-8bbe-299f7888d6c9", "tag": "3a3f4de9-615b-4419-87d6-e78feae8eeda"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:45.395052 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-ab44a64a-e105-4da2-b6a2-9adeef7d9d96 req-80c34d36-795c-42f8-be58-7528a10b963e service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:45.395532 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-ab44a64a-e105-4da2-b6a2-9adeef7d9d96 req-80c34d36-795c-42f8-be58-7528a10b963e service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:45.395997 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-ab44a64a-e105-4da2-b6a2-9adeef7d9d96 req-80c34d36-795c-42f8-be58-7528a10b963e service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:45.408470 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-ab44a64a-e105-4da2-b6a2-9adeef7d9d96 req-80c34d36-795c-42f8-be58-7528a10b963e service nova] Creating event network-changed:3a3f4de9-615b-4419-87d6-e78feae8eeda for instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 on hv-cinder-85391 Aug 22 05:45:45.414385 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-ab44a64a-e105-4da2-b6a2-9adeef7d9d96 req-80c34d36-795c-42f8-be58-7528a10b963e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033607 Aug 22 05:45:45.415184 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 391/770] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:45:45.491953 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e580dcee-36f0-4883-8e52-54d336583fab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:45.500051 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e580dcee-36f0-4883-8e52-54d336583fab tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1521 microversion: 2.1 time: 0.167976 Aug 22 05:45:45.500774 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 380/771] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:45 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:45.590220 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-96a8c227-7f2b-4ac1-8840-e873753df9cc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:45.590854 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-96a8c227-7f2b-4ac1-8840-e873753df9cc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:45.597586 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-96a8c227-7f2b-4ac1-8840-e873753df9cc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:45.598070 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-96a8c227-7f2b-4ac1-8840-e873753df9cc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:45.598570 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-96a8c227-7f2b-4ac1-8840-e873753df9cc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:45.599182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-96a8c227-7f2b-4ac1-8840-e873753df9cc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:45.599678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-96a8c227-7f2b-4ac1-8840-e873753df9cc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:45.600092 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-96a8c227-7f2b-4ac1-8840-e873753df9cc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:45.742600 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-96a8c227-7f2b-4ac1-8840-e873753df9cc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:45.750411 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-96a8c227-7f2b-4ac1-8840-e873753df9cc tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 200 len: 1363 microversion: 2.1 time: 0.165023 Aug 22 05:45:45.751236 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 392/772] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:45 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:45.909322 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d7c4df5b-994f-4410-8d04-035f7a301ca6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:45.909996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d7c4df5b-994f-4410-8d04-035f7a301ca6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:45.916581 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7c4df5b-994f-4410-8d04-035f7a301ca6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:45.917027 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7c4df5b-994f-4410-8d04-035f7a301ca6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:45.917452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7c4df5b-994f-4410-8d04-035f7a301ca6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:45.918135 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7c4df5b-994f-4410-8d04-035f7a301ca6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:45.918576 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7c4df5b-994f-4410-8d04-035f7a301ca6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:45.918987 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d7c4df5b-994f-4410-8d04-035f7a301ca6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:46.133882 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d7c4df5b-994f-4410-8d04-035f7a301ca6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:46.143306 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d7c4df5b-994f-4410-8d04-035f7a301ca6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:46.145021 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d7c4df5b-994f-4410-8d04-035f7a301ca6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:46.146633 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d7c4df5b-994f-4410-8d04-035f7a301ca6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1407 microversion: 2.20 time: 0.243197 Aug 22 05:45:46.147225 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 381/773] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:45:45 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:45:46.521814 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-88c23bc0-f037-4a7b-ad1e-946e4b434273 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:46.522408 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-88c23bc0-f037-4a7b-ad1e-946e4b434273 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:46.529181 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-88c23bc0-f037-4a7b-ad1e-946e4b434273 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:46.529709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-88c23bc0-f037-4a7b-ad1e-946e4b434273 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:46.530072 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-88c23bc0-f037-4a7b-ad1e-946e4b434273 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:46.530771 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-88c23bc0-f037-4a7b-ad1e-946e4b434273 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:46.531217 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-88c23bc0-f037-4a7b-ad1e-946e4b434273 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:46.531651 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-88c23bc0-f037-4a7b-ad1e-946e4b434273 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:46.596327 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-88c23bc0-f037-4a7b-ad1e-946e4b434273 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:46.604075 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-88c23bc0-f037-4a7b-ad1e-946e4b434273 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1479 microversion: 2.1 time: 0.086352 Aug 22 05:45:46.604639 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 393/774] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:46 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1479 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:46.774663 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2b5d6a5c-ed36-4491-98ec-ecefc2a573c3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:46.774663 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2b5d6a5c-ed36-4491-98ec-ecefc2a573c3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:46.783669 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b5d6a5c-ed36-4491-98ec-ecefc2a573c3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:46.784560 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b5d6a5c-ed36-4491-98ec-ecefc2a573c3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:46.785019 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b5d6a5c-ed36-4491-98ec-ecefc2a573c3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:46.785965 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b5d6a5c-ed36-4491-98ec-ecefc2a573c3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:46.786632 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b5d6a5c-ed36-4491-98ec-ecefc2a573c3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:46.787268 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b5d6a5c-ed36-4491-98ec-ecefc2a573c3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:46.930970 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2b5d6a5c-ed36-4491-98ec-ecefc2a573c3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:46.938969 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2b5d6a5c-ed36-4491-98ec-ecefc2a573c3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 200 len: 1549 microversion: 2.1 time: 0.170533 Aug 22 05:45:46.939883 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 382/775] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:46 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:46.959604 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6e2bee24-0ad8-4486-8ea3-bbcc1dee828c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:46.960018 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-6e2bee24-0ad8-4486-8ea3-bbcc1dee828c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:46.966489 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6e2bee24-0ad8-4486-8ea3-bbcc1dee828c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:46.966977 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6e2bee24-0ad8-4486-8ea3-bbcc1dee828c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:46.967429 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6e2bee24-0ad8-4486-8ea3-bbcc1dee828c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:46.968123 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6e2bee24-0ad8-4486-8ea3-bbcc1dee828c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:46.968566 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6e2bee24-0ad8-4486-8ea3-bbcc1dee828c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:46.968974 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6e2bee24-0ad8-4486-8ea3-bbcc1dee828c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:47.051498 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6e2bee24-0ad8-4486-8ea3-bbcc1dee828c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095763 Aug 22 05:45:47.052354 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 394/776] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Aug 22 05:45:46 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:45:47.169219 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5efac5bd-1b45-4d8b-8fd3-a127a9547727 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:47.169852 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5efac5bd-1b45-4d8b-8fd3-a127a9547727 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:47.171972 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:45:47.178211 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5efac5bd-1b45-4d8b-8fd3-a127a9547727 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:47.178708 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5efac5bd-1b45-4d8b-8fd3-a127a9547727 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:47.179132 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5efac5bd-1b45-4d8b-8fd3-a127a9547727 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:47.179862 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5efac5bd-1b45-4d8b-8fd3-a127a9547727 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:47.180310 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5efac5bd-1b45-4d8b-8fd3-a127a9547727 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:47.180729 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5efac5bd-1b45-4d8b-8fd3-a127a9547727 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:47.432944 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-15766c14-87eb-4740-8e56-8337570a1534 req-782a78df-075f-4b51-9fe6-e640b208d7de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ee8e71-810f-4f41-af8a-9bed26135368", "name": "network-vif-deleted", "tag": "977bea28-5f40-42b4-ad5a-b1856e7e992b"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:47.443207 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-15766c14-87eb-4740-8e56-8337570a1534 req-782a78df-075f-4b51-9fe6-e640b208d7de service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:47.443541 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-15766c14-87eb-4740-8e56-8337570a1534 req-782a78df-075f-4b51-9fe6-e640b208d7de service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:47.444018 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-15766c14-87eb-4740-8e56-8337570a1534 req-782a78df-075f-4b51-9fe6-e640b208d7de service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:47.445639 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5efac5bd-1b45-4d8b-8fd3-a127a9547727 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:47.455397 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5efac5bd-1b45-4d8b-8fd3-a127a9547727 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:47.456134 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-15766c14-87eb-4740-8e56-8337570a1534 req-782a78df-075f-4b51-9fe6-e640b208d7de service nova] Creating event network-vif-deleted:977bea28-5f40-42b4-ad5a-b1856e7e992b for instance f8ee8e71-810f-4f41-af8a-9bed26135368 on hv-cinder-85391 Aug 22 05:45:47.456924 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5efac5bd-1b45-4d8b-8fd3-a127a9547727 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:47.458248 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5efac5bd-1b45-4d8b-8fd3-a127a9547727 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1407 microversion: 2.20 time: 0.293091 Aug 22 05:45:47.471605 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 383/777] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:45:47 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1407 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:45:47.472178 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-15766c14-87eb-4740-8e56-8337570a1534 req-782a78df-075f-4b51-9fe6-e640b208d7de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032262 Aug 22 05:45:47.472178 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 395/778] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:45:47.625748 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-025e90e9-9b97-4dcc-bfd3-306165d92862 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:47.626450 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-025e90e9-9b97-4dcc-bfd3-306165d92862 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:47.632979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025e90e9-9b97-4dcc-bfd3-306165d92862 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:47.633465 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025e90e9-9b97-4dcc-bfd3-306165d92862 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:47.633892 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025e90e9-9b97-4dcc-bfd3-306165d92862 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:47.634578 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025e90e9-9b97-4dcc-bfd3-306165d92862 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:47.635016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025e90e9-9b97-4dcc-bfd3-306165d92862 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:47.635436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025e90e9-9b97-4dcc-bfd3-306165d92862 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:47.725668 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-025e90e9-9b97-4dcc-bfd3-306165d92862 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:47.734688 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-025e90e9-9b97-4dcc-bfd3-306165d92862 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1307 microversion: 2.1 time: 0.112748 Aug 22 05:45:47.735493 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 384/779] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:47 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:48.106430 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-9f411728-a45c-434c-b45b-c273ba2e77a9 req-e1f8a4c4-e055-4efe-bcf3-ea12c63d7f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75fe69ea-b7a4-42f9-b222-4eea23123c62", "tag": "83c31f1b-d8da-4975-a21b-2e8a4c789571"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:48.116367 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-9f411728-a45c-434c-b45b-c273ba2e77a9 req-e1f8a4c4-e055-4efe-bcf3-ea12c63d7f12 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:48.116845 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-9f411728-a45c-434c-b45b-c273ba2e77a9 req-e1f8a4c4-e055-4efe-bcf3-ea12c63d7f12 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:48.117269 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-9f411728-a45c-434c-b45b-c273ba2e77a9 req-e1f8a4c4-e055-4efe-bcf3-ea12c63d7f12 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:48.128512 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-9f411728-a45c-434c-b45b-c273ba2e77a9 req-e1f8a4c4-e055-4efe-bcf3-ea12c63d7f12 service nova] Creating event network-changed:83c31f1b-d8da-4975-a21b-2e8a4c789571 for instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 on hv-cinder-85391 Aug 22 05:45:48.133557 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-9f411728-a45c-434c-b45b-c273ba2e77a9 req-e1f8a4c4-e055-4efe-bcf3-ea12c63d7f12 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031651 Aug 22 05:45:48.134156 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 396/780] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:45:48.482793 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e9378278-2b2e-4a33-974b-59291fa96bd2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:48.483369 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e9378278-2b2e-4a33-974b-59291fa96bd2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:48.490474 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e9378278-2b2e-4a33-974b-59291fa96bd2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:48.490944 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e9378278-2b2e-4a33-974b-59291fa96bd2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:48.491372 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e9378278-2b2e-4a33-974b-59291fa96bd2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:48.492089 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e9378278-2b2e-4a33-974b-59291fa96bd2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:48.492521 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e9378278-2b2e-4a33-974b-59291fa96bd2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:48.492936 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e9378278-2b2e-4a33-974b-59291fa96bd2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:48.622516 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e9378278-2b2e-4a33-974b-59291fa96bd2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:48.631304 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e9378278-2b2e-4a33-974b-59291fa96bd2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:48.632804 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e9378278-2b2e-4a33-974b-59291fa96bd2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:48.633902 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e9378278-2b2e-4a33-974b-59291fa96bd2 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1407 microversion: 2.20 time: 0.155387 Aug 22 05:45:48.634468 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 385/781] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:45:48 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:45:48.758080 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-1e8d9471-5fe9-466d-bd8e-af9df373e1f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:48.759019 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-1e8d9471-5fe9-466d-bd8e-af9df373e1f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:48.766822 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1e8d9471-5fe9-466d-bd8e-af9df373e1f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:48.767661 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1e8d9471-5fe9-466d-bd8e-af9df373e1f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:48.768153 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1e8d9471-5fe9-466d-bd8e-af9df373e1f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:48.769101 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1e8d9471-5fe9-466d-bd8e-af9df373e1f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:48.770254 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1e8d9471-5fe9-466d-bd8e-af9df373e1f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:48.770853 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1e8d9471-5fe9-466d-bd8e-af9df373e1f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:48.881863 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-1e8d9471-5fe9-466d-bd8e-af9df373e1f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9643b0f10e8345889c181efbb1978237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cadb48afce14e758bfe62771530527a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:48.889840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-1e8d9471-5fe9-466d-bd8e-af9df373e1f3 tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 200 len: 1307 microversion: 2.1 time: 0.137059 Aug 22 05:45:48.890498 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 397/782] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:48 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 1307 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:45:49.655654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-74229018-ba20-437e-b20f-63a4bb3a3900 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:49.656228 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-74229018-ba20-437e-b20f-63a4bb3a3900 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:49.662689 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74229018-ba20-437e-b20f-63a4bb3a3900 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:49.663144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74229018-ba20-437e-b20f-63a4bb3a3900 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:49.663595 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74229018-ba20-437e-b20f-63a4bb3a3900 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:49.664317 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74229018-ba20-437e-b20f-63a4bb3a3900 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:49.664744 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74229018-ba20-437e-b20f-63a4bb3a3900 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:49.665159 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74229018-ba20-437e-b20f-63a4bb3a3900 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:49.669380 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:45:49.804627 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-74229018-ba20-437e-b20f-63a4bb3a3900 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:49.813253 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-74229018-ba20-437e-b20f-63a4bb3a3900 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:49.815167 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-74229018-ba20-437e-b20f-63a4bb3a3900 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:49.816313 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-74229018-ba20-437e-b20f-63a4bb3a3900 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1407 microversion: 2.20 time: 0.164619 Aug 22 05:45:49.816883 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 386/783] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:45:49 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:45:49.910837 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4332fe62-c23b-4c23-b148-5d2c994cef7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:49.911450 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4332fe62-c23b-4c23-b148-5d2c994cef7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] [instance: f8ee8e71-810f-4f41-af8a-9bed26135368] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:49.918229 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4332fe62-c23b-4c23-b148-5d2c994cef7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:49.918712 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4332fe62-c23b-4c23-b148-5d2c994cef7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:49.919146 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4332fe62-c23b-4c23-b148-5d2c994cef7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:49.919877 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4332fe62-c23b-4c23-b148-5d2c994cef7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:49.920359 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4332fe62-c23b-4c23-b148-5d2c994cef7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:49.920782 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4332fe62-c23b-4c23-b148-5d2c994cef7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:49.935749 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-4332fe62-c23b-4c23-b148-5d2c994cef7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] HTTP exception thrown: Instance f8ee8e71-810f-4f41-af8a-9bed26135368 could not be found. Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4332fe62-c23b-4c23-b148-5d2c994cef7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Request method failure captured: Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 HTTP/1.1 Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxZJ7BdnzK-u4DKWWTr2FX2u5pwmnE2XjOu8umL3m5FZVx9vs8-L9guf58r47bG_oFQDAwD733BJkilMph8nunSZNTzBoLdMj0DH2XIL-y0pAdClU7WOEjgndU2mtYSxv2QT6l_KuebCiUPUyx_PUd635STXp1Lia-VSwvM8EBbSje4 Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: 8cadb48afce14e758bfe62771530527a Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1818501039 Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:45:49.937391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:45:49.938907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8cadb48afce14e758bfe62771530527a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cadb48afce14e758bfe62771530527a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cadb48afce14e758bfe62771530527a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8cadb48afce14e758bfe62771530527a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:45:49.938907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1818501039 Aug 22 05:45:49.938907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: 8cadb48afce14e758bfe62771530527a Aug 22 05:45:49.938907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1818501039 Aug 22 05:45:49.938907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-ServerRescueNegativeTestJSON-1818501039-project Aug 22 05:45:49.938907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:45:49.938907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:45:49.938907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: 9643b0f10e8345889c181efbb1978237 Aug 22 05:45:49.938907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1818501039-project Aug 22 05:45:49.938907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:45:49.938907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance f8ee8e71-810f-4f41-af8a-9bed26135368 could not be found. Aug 22 05:45:49.938907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': 'f8ee8e71-810f-4f41-af8a-9bed26135368'} Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ee8e71-810f-4f41-af8a-9bed26135368 could not be found. Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:45:49.940709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ee8e71-810f-4f41-af8a-9bed26135368 could not be found. Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ee8e71-810f-4f41-af8a-9bed26135368 could not be found. Aug 22 05:45:49.942164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:45:49.943440 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4332fe62-c23b-4c23-b148-5d2c994cef7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] Returning 404 to user: Instance f8ee8e71-810f-4f41-af8a-9bed26135368 could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:45:49.943440 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4332fe62-c23b-4c23-b148-5d2c994cef7a tempest-ServerRescueNegativeTestJSON-1818501039 tempest-ServerRescueNegativeTestJSON-1818501039-project] 10.222.0.18 "GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368" status: 404 len: 111 microversion: 2.1 time: 0.032300 Aug 22 05:45:49.943440 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 398/784] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:45:49 2022] GET /compute/v2.1/servers/f8ee8e71-810f-4f41-af8a-9bed26135368 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:45:50.840018 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-53370302-eebd-460b-befa-50081d38446a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:50.840618 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-53370302-eebd-460b-befa-50081d38446a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:50.847627 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-53370302-eebd-460b-befa-50081d38446a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:50.848236 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-53370302-eebd-460b-befa-50081d38446a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:50.848681 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-53370302-eebd-460b-befa-50081d38446a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:50.849363 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-53370302-eebd-460b-befa-50081d38446a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:50.849869 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-53370302-eebd-460b-befa-50081d38446a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:50.850297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-53370302-eebd-460b-befa-50081d38446a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:51.063023 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-53370302-eebd-460b-befa-50081d38446a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:51.072610 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-53370302-eebd-460b-befa-50081d38446a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:51.075423 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-53370302-eebd-460b-befa-50081d38446a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:51.075423 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-53370302-eebd-460b-befa-50081d38446a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1407 microversion: 2.20 time: 0.240018 Aug 22 05:45:51.076276 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 387/785] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:45:50 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:45:51.372263 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-a54a312a-8457-4440-b42c-0164d06040b4 req-2ed525b2-26e0-4408-9390-d412891caffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64c75c4-9ba2-408f-8bbe-299f7888d6c9", "name": "network-vif-plugged", "status": "completed", "tag": "3a3f4de9-615b-4419-87d6-e78feae8eeda"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:51.388506 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=2 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:45:51.391387 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=14 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:45:51.394458 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-a54a312a-8457-4440-b42c-0164d06040b4 req-2ed525b2-26e0-4408-9390-d412891caffa service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:51.395541 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-a54a312a-8457-4440-b42c-0164d06040b4 req-2ed525b2-26e0-4408-9390-d412891caffa service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:51.396409 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-a54a312a-8457-4440-b42c-0164d06040b4 req-2ed525b2-26e0-4408-9390-d412891caffa service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:51.411402 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-a54a312a-8457-4440-b42c-0164d06040b4 req-2ed525b2-26e0-4408-9390-d412891caffa service nova] Creating event network-vif-plugged:3a3f4de9-615b-4419-87d6-e78feae8eeda for instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 on hv-cinder-85391 Aug 22 05:45:51.420883 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-a54a312a-8457-4440-b42c-0164d06040b4 req-2ed525b2-26e0-4408-9390-d412891caffa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053073 Aug 22 05:45:51.422795 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 399/786] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:45:52.098942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-03d5a30b-67fa-4d88-839f-45801730b290 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:52.099553 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-03d5a30b-67fa-4d88-839f-45801730b290 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:52.101860 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=10 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:45:52.108811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03d5a30b-67fa-4d88-839f-45801730b290 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:52.109262 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03d5a30b-67fa-4d88-839f-45801730b290 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:52.109683 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03d5a30b-67fa-4d88-839f-45801730b290 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:52.110573 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03d5a30b-67fa-4d88-839f-45801730b290 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:52.110982 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03d5a30b-67fa-4d88-839f-45801730b290 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:52.111542 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03d5a30b-67fa-4d88-839f-45801730b290 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:52.365588 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-03d5a30b-67fa-4d88-839f-45801730b290 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:52.374759 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-03d5a30b-67fa-4d88-839f-45801730b290 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:52.376526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-03d5a30b-67fa-4d88-839f-45801730b290 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:52.377638 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-03d5a30b-67fa-4d88-839f-45801730b290 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1407 microversion: 2.20 time: 0.283030 Aug 22 05:45:52.378168 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 388/787] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:45:52 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:45:53.410722 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-99452602-6633-4b96-af1d-d71d46ca102e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:53.412021 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-99452602-6633-4b96-af1d-d71d46ca102e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:53.419738 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-99452602-6633-4b96-af1d-d71d46ca102e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:53.420770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-99452602-6633-4b96-af1d-d71d46ca102e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:53.421413 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-99452602-6633-4b96-af1d-d71d46ca102e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:53.422436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-99452602-6633-4b96-af1d-d71d46ca102e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:53.423031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-99452602-6633-4b96-af1d-d71d46ca102e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:53.423631 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-99452602-6633-4b96-af1d-d71d46ca102e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:53.677434 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-99452602-6633-4b96-af1d-d71d46ca102e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:53.682659 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:45:53.687345 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-99452602-6633-4b96-af1d-d71d46ca102e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:53.688888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-99452602-6633-4b96-af1d-d71d46ca102e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:45:53.690038 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-99452602-6633-4b96-af1d-d71d46ca102e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1599 microversion: 2.20 time: 0.293841 Aug 22 05:45:53.691011 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 400/788] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:45:53 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1599 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:45:53.712433 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4005fe3c-6709-404d-a977-8bdb10afdf8a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:45:53.713910 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4005fe3c-6709-404d-a977-8bdb10afdf8a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:45:53.721119 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4005fe3c-6709-404d-a977-8bdb10afdf8a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:53.721825 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4005fe3c-6709-404d-a977-8bdb10afdf8a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:53.722405 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4005fe3c-6709-404d-a977-8bdb10afdf8a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:53.723379 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4005fe3c-6709-404d-a977-8bdb10afdf8a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:53.724063 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4005fe3c-6709-404d-a977-8bdb10afdf8a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:53.724875 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4005fe3c-6709-404d-a977-8bdb10afdf8a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:53.840992 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4005fe3c-6709-404d-a977-8bdb10afdf8a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.132373 Aug 22 05:45:53.841587 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 389/789] 10.222.0.18 () {60 vars in 1316 bytes} [Mon Aug 22 05:45:53 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:45:55.072853 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-8375630e-9ba7-4991-80d4-ef6773cdd2f3 req-3b52dca3-eb87-4270-a616-97be2504ab2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d64c75c4-9ba2-408f-8bbe-299f7888d6c9", "tag": "3a3f4de9-615b-4419-87d6-e78feae8eeda"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:45:55.085262 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-8375630e-9ba7-4991-80d4-ef6773cdd2f3 req-3b52dca3-eb87-4270-a616-97be2504ab2f service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:45:55.085972 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-8375630e-9ba7-4991-80d4-ef6773cdd2f3 req-3b52dca3-eb87-4270-a616-97be2504ab2f service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:45:55.086581 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-8375630e-9ba7-4991-80d4-ef6773cdd2f3 req-3b52dca3-eb87-4270-a616-97be2504ab2f service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:45:55.099171 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-8375630e-9ba7-4991-80d4-ef6773cdd2f3 req-3b52dca3-eb87-4270-a616-97be2504ab2f service nova] Creating event network-changed:3a3f4de9-615b-4419-87d6-e78feae8eeda for instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 on hv-cinder-85391 Aug 22 05:45:55.104479 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-8375630e-9ba7-4991-80d4-ef6773cdd2f3 req-3b52dca3-eb87-4270-a616-97be2504ab2f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035736 Aug 22 05:45:55.105240 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 401/790] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:47:00.041194 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=13 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:47:00.041998 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=20 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:47:00.046208 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:47:00.050804 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-4386a1c7-dc86-4bbf-8782-4d17b73f9cb7 req-2481a94f-8066-4566-a37d-e529bfba52aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57433a27-1ab9-4b19-b87b-fc2c80644b94", "tag": "d68e991c-9283-490b-b88a-5d68f84a5bd6"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:47:00.056300 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6a3b4eb2-59e1-4d95-91ea-ff7fa82d9366 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:00.057470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6a3b4eb2-59e1-4d95-91ea-ff7fa82d9366 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:00.072982 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a3b4eb2-59e1-4d95-91ea-ff7fa82d9366 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:00.073483 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a3b4eb2-59e1-4d95-91ea-ff7fa82d9366 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:00.073919 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a3b4eb2-59e1-4d95-91ea-ff7fa82d9366 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:00.074638 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a3b4eb2-59e1-4d95-91ea-ff7fa82d9366 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:00.075076 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a3b4eb2-59e1-4d95-91ea-ff7fa82d9366 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:00.075489 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a3b4eb2-59e1-4d95-91ea-ff7fa82d9366 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:00.080264 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-4386a1c7-dc86-4bbf-8782-4d17b73f9cb7 req-2481a94f-8066-4566-a37d-e529bfba52aa service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:00.080992 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-4386a1c7-dc86-4bbf-8782-4d17b73f9cb7 req-2481a94f-8066-4566-a37d-e529bfba52aa service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:00.081539 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-4386a1c7-dc86-4bbf-8782-4d17b73f9cb7 req-2481a94f-8066-4566-a37d-e529bfba52aa service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:00.094610 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-4386a1c7-dc86-4bbf-8782-4d17b73f9cb7 req-2481a94f-8066-4566-a37d-e529bfba52aa service nova] Creating event network-changed:d68e991c-9283-490b-b88a-5d68f84a5bd6 for instance 57433a27-1ab9-4b19-b87b-fc2c80644b94 on hv-cinder-85391 Aug 22 05:47:00.099504 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-4386a1c7-dc86-4bbf-8782-4d17b73f9cb7 req-2481a94f-8066-4566-a37d-e529bfba52aa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055640 Aug 22 05:47:00.100514 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 402/791] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:47:00.102130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6a3b4eb2-59e1-4d95-91ea-ff7fa82d9366 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:47:00.189532 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6a3b4eb2-59e1-4d95-91ea-ff7fa82d9366 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "DELETE /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 204 len: 0 microversion: 2.1 time: 0.150373 Aug 22 05:47:00.190131 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 390/792] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:47:00 2022] DELETE /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:47:00.199141 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4a6a4d0c-f8fb-43e7-a37d-84bd9b35ad62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:00.200081 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4a6a4d0c-f8fb-43e7-a37d-84bd9b35ad62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:00.209771 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4a6a4d0c-f8fb-43e7-a37d-84bd9b35ad62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:00.212217 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4a6a4d0c-f8fb-43e7-a37d-84bd9b35ad62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:00.213205 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4a6a4d0c-f8fb-43e7-a37d-84bd9b35ad62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:00.214397 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4a6a4d0c-f8fb-43e7-a37d-84bd9b35ad62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:00.215467 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4a6a4d0c-f8fb-43e7-a37d-84bd9b35ad62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:00.215997 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4a6a4d0c-f8fb-43e7-a37d-84bd9b35ad62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:00.360795 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4a6a4d0c-f8fb-43e7-a37d-84bd9b35ad62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:00.369343 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4a6a4d0c-f8fb-43e7-a37d-84bd9b35ad62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1570 microversion: 2.1 time: 0.174093 Aug 22 05:47:00.370019 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 403/793] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:00 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:47:01.392059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5756d11a-7c7d-4208-bc8f-ad26ae98bc62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:01.392946 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5756d11a-7c7d-4208-bc8f-ad26ae98bc62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:01.402603 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5756d11a-7c7d-4208-bc8f-ad26ae98bc62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:01.403237 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5756d11a-7c7d-4208-bc8f-ad26ae98bc62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:01.403879 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5756d11a-7c7d-4208-bc8f-ad26ae98bc62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:01.404942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5756d11a-7c7d-4208-bc8f-ad26ae98bc62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:01.405575 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5756d11a-7c7d-4208-bc8f-ad26ae98bc62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:01.406094 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5756d11a-7c7d-4208-bc8f-ad26ae98bc62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:01.547297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5756d11a-7c7d-4208-bc8f-ad26ae98bc62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:01.555033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5756d11a-7c7d-4208-bc8f-ad26ae98bc62 tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1570 microversion: 2.1 time: 0.167336 Aug 22 05:47:01.555610 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 391/794] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:01 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:47:02.365848 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-c93d8d9a-8eae-48d1-b02b-296798a3e8e5 req-13b34787-ed0e-42c3-b73a-53a80c3f0109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57433a27-1ab9-4b19-b87b-fc2c80644b94", "name": "network-vif-deleted", "tag": "d68e991c-9283-490b-b88a-5d68f84a5bd6"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:47:02.376982 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-c93d8d9a-8eae-48d1-b02b-296798a3e8e5 req-13b34787-ed0e-42c3-b73a-53a80c3f0109 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:02.377471 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-c93d8d9a-8eae-48d1-b02b-296798a3e8e5 req-13b34787-ed0e-42c3-b73a-53a80c3f0109 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:02.377892 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-c93d8d9a-8eae-48d1-b02b-296798a3e8e5 req-13b34787-ed0e-42c3-b73a-53a80c3f0109 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:02.390802 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-c93d8d9a-8eae-48d1-b02b-296798a3e8e5 req-13b34787-ed0e-42c3-b73a-53a80c3f0109 service nova] Creating event network-vif-deleted:d68e991c-9283-490b-b88a-5d68f84a5bd6 for instance 57433a27-1ab9-4b19-b87b-fc2c80644b94 on hv-cinder-85391 Aug 22 05:47:02.395746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-c93d8d9a-8eae-48d1-b02b-296798a3e8e5 req-13b34787-ed0e-42c3-b73a-53a80c3f0109 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033791 Aug 22 05:47:02.396617 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 404/795] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:47:02.576960 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0e8ea354-23ed-437f-832a-3ae6dfb155cf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:02.577531 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0e8ea354-23ed-437f-832a-3ae6dfb155cf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:02.584276 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0e8ea354-23ed-437f-832a-3ae6dfb155cf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:02.584830 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0e8ea354-23ed-437f-832a-3ae6dfb155cf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:02.585327 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0e8ea354-23ed-437f-832a-3ae6dfb155cf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:02.586010 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0e8ea354-23ed-437f-832a-3ae6dfb155cf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:02.586484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0e8ea354-23ed-437f-832a-3ae6dfb155cf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:02.586930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0e8ea354-23ed-437f-832a-3ae6dfb155cf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:02.653973 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0e8ea354-23ed-437f-832a-3ae6dfb155cf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4010e99c30b4a49b19c6b8fa2b5f7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a0c07a94f43d4807931639fd6a93e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:02.663155 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0e8ea354-23ed-437f-832a-3ae6dfb155cf tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 200 len: 1219 microversion: 2.1 time: 0.090547 Aug 22 05:47:02.664117 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 392/796] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:02 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:47:03.367770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-02667b76-d835-43d1-97ec-4ca01ce3b9a3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:03.368514 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-02667b76-d835-43d1-97ec-4ca01ce3b9a3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:03.376570 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-02667b76-d835-43d1-97ec-4ca01ce3b9a3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:03.377159 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-02667b76-d835-43d1-97ec-4ca01ce3b9a3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:03.377694 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-02667b76-d835-43d1-97ec-4ca01ce3b9a3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:03.378542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-02667b76-d835-43d1-97ec-4ca01ce3b9a3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:03.379091 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-02667b76-d835-43d1-97ec-4ca01ce3b9a3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:03.379633 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-02667b76-d835-43d1-97ec-4ca01ce3b9a3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:03.404509 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-02667b76-d835-43d1-97ec-4ca01ce3b9a3 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/ips" status: 200 len: 146 microversion: 2.1 time: 0.042172 Aug 22 05:47:03.405070 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 405/797] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 22 05:47:03 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:47:03.686182 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c36fa459-5ed1-412c-8650-ee578a50a77a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:03.687351 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c36fa459-5ed1-412c-8650-ee578a50a77a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] [instance: 57433a27-1ab9-4b19-b87b-fc2c80644b94] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:03.694751 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c36fa459-5ed1-412c-8650-ee578a50a77a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:03.695325 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c36fa459-5ed1-412c-8650-ee578a50a77a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:03.695876 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c36fa459-5ed1-412c-8650-ee578a50a77a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:03.696661 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c36fa459-5ed1-412c-8650-ee578a50a77a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:03.697225 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c36fa459-5ed1-412c-8650-ee578a50a77a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:03.697727 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c36fa459-5ed1-412c-8650-ee578a50a77a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:03.715182 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-c36fa459-5ed1-412c-8650-ee578a50a77a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] HTTP exception thrown: Instance 57433a27-1ab9-4b19-b87b-fc2c80644b94 could not be found. Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c36fa459-5ed1-412c-8650-ee578a50a77a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Request method failure captured: Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 HTTP/1.1 Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxbskj-Yxz77mb1xhKstAPH7mGqcXuo4Y99VFFja0ZWTaqfAxpR6SleLqwOoo7-_iomvbg0UaLenFdxFDLDsoVZBUrQdv3yO1SIQK2UgI6QS-R8F32FnpDjanv2KaSwctZcqjzNUm-MqBUCqMbnZo7tb6PkiEos9XXRQV0v-vJmk_mU Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 638a0c07a94f43d4807931639fd6a93e Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-TestShelveInstance-271821913 Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:47:03.716995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:47:03.718902 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_638a0c07a94f43d4807931639fd6a93e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/638a0c07a94f43d4807931639fd6a93e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/638a0c07a94f43d4807931639fd6a93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/638a0c07a94f43d4807931639fd6a93e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:47:03.718902 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-TestShelveInstance-271821913 Aug 22 05:47:03.718902 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 638a0c07a94f43d4807931639fd6a93e Aug 22 05:47:03.718902 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-TestShelveInstance-271821913 Aug 22 05:47:03.718902 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-TestShelveInstance-271821913-project Aug 22 05:47:03.718902 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:47:03.718902 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:47:03.718902 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: f4010e99c30b4a49b19c6b8fa2b5f7f2 Aug 22 05:47:03.718902 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-TestShelveInstance-271821913-project Aug 22 05:47:03.718902 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:47:03.718902 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 57433a27-1ab9-4b19-b87b-fc2c80644b94 could not be found. Aug 22 05:47:03.718902 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '57433a27-1ab9-4b19-b87b-fc2c80644b94'} Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57433a27-1ab9-4b19-b87b-fc2c80644b94 could not be found. Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:47:03.720017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57433a27-1ab9-4b19-b87b-fc2c80644b94 could not be found. Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57433a27-1ab9-4b19-b87b-fc2c80644b94 could not be found. Aug 22 05:47:03.721509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:03.722863 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c36fa459-5ed1-412c-8650-ee578a50a77a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Returning 404 to user: Instance 57433a27-1ab9-4b19-b87b-fc2c80644b94 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:47:03.722863 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c36fa459-5ed1-412c-8650-ee578a50a77a tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94" status: 404 len: 111 microversion: 2.1 time: 0.036797 Aug 22 05:47:03.722863 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 393/798] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:03 2022] GET /compute/v2.1/servers/57433a27-1ab9-4b19-b87b-fc2c80644b94 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:47:03.890623 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-1f5dad55-3286-47fb-b8ae-fa8f23529d4d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] Calling method '.version_select at 0x7f0b3df20ca0>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:03.914096 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-1f5dad55-3286-47fb-b8ae-fa8f23529d4d tempest-TestShelveInstance-271821913 tempest-TestShelveInstance-271821913-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-364360750" status: 202 len: 0 microversion: 2.1 time: 0.027022 Aug 22 05:47:03.914688 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 406/799] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 22 05:47:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-364360750 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:47:04.757620 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-962b8052-4691-4fbc-91e3-15cf7fcd4703 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7556309a-c1f4-48bd-b252-00bf4803ca16"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:47:04.760255 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-962b8052-4691-4fbc-91e3-15cf7fcd4703 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:04.767247 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-962b8052-4691-4fbc-91e3-15cf7fcd4703 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:04.767892 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-962b8052-4691-4fbc-91e3-15cf7fcd4703 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:04.768397 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-962b8052-4691-4fbc-91e3-15cf7fcd4703 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:04.769180 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-962b8052-4691-4fbc-91e3-15cf7fcd4703 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:04.769706 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-962b8052-4691-4fbc-91e3-15cf7fcd4703 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:04.770198 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-962b8052-4691-4fbc-91e3-15cf7fcd4703 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:05.039433 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-962b8052-4691-4fbc-91e3-15cf7fcd4703 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "POST /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285837 Aug 22 05:47:05.040311 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 394/800] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 22 05:47:04 2022] POST /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:47:11.596820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b54f9059-9595-4375-b7fe-b38c27ab9a9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:11.597468 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b54f9059-9595-4375-b7fe-b38c27ab9a9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:11.604567 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b54f9059-9595-4375-b7fe-b38c27ab9a9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:11.605124 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b54f9059-9595-4375-b7fe-b38c27ab9a9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:11.605768 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b54f9059-9595-4375-b7fe-b38c27ab9a9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:11.606467 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b54f9059-9595-4375-b7fe-b38c27ab9a9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:11.606922 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b54f9059-9595-4375-b7fe-b38c27ab9a9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:11.607338 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b54f9059-9595-4375-b7fe-b38c27ab9a9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:11.633673 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b54f9059-9595-4375-b7fe-b38c27ab9a9d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9/ips" status: 200 len: 152 microversion: 2.20 time: 0.041440 Aug 22 05:47:11.634260 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 407/801] 10.222.0.18 () {60 vars in 1289 bytes} [Mon Aug 22 05:47:11 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:47:12.611106 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-237fc3c5-2fd7-4f0b-82cb-422c3b701bdd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:12.613511 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-237fc3c5-2fd7-4f0b-82cb-422c3b701bdd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:12.619978 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-237fc3c5-2fd7-4f0b-82cb-422c3b701bdd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:12.620473 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-237fc3c5-2fd7-4f0b-82cb-422c3b701bdd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:12.620900 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-237fc3c5-2fd7-4f0b-82cb-422c3b701bdd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:12.621611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-237fc3c5-2fd7-4f0b-82cb-422c3b701bdd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:12.622061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-237fc3c5-2fd7-4f0b-82cb-422c3b701bdd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:12.622477 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-237fc3c5-2fd7-4f0b-82cb-422c3b701bdd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:12.652287 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-237fc3c5-2fd7-4f0b-82cb-422c3b701bdd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046210 Aug 22 05:47:12.652851 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 395/802] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 22 05:47:12 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:47:12.663947 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4705f886-2fca-4400-94a1-7493ca36b49a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:12.664432 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4705f886-2fca-4400-94a1-7493ca36b49a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:12.671491 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4705f886-2fca-4400-94a1-7493ca36b49a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:12.672002 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4705f886-2fca-4400-94a1-7493ca36b49a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:12.672435 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4705f886-2fca-4400-94a1-7493ca36b49a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:12.673125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4705f886-2fca-4400-94a1-7493ca36b49a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:12.673574 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4705f886-2fca-4400-94a1-7493ca36b49a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:12.673995 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4705f886-2fca-4400-94a1-7493ca36b49a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:12.704182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4705f886-2fca-4400-94a1-7493ca36b49a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments/7556309a-c1f4-48bd-b252-00bf4803ca16" status: 200 len: 194 microversion: 2.1 time: 0.044226 Aug 22 05:47:12.704768 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 408/803] 10.222.0.18 () {58 vars in 1413 bytes} [Mon Aug 22 05:47:12 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments/7556309a-c1f4-48bd-b252-00bf4803ca16 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:47:13.909162 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9982c047-493f-47d8-9f4b-2a85260660d8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:47:13.910014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9982c047-493f-47d8-9f4b-2a85260660d8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:13.920398 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9982c047-493f-47d8-9f4b-2a85260660d8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:13.920864 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9982c047-493f-47d8-9f4b-2a85260660d8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:13.921323 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9982c047-493f-47d8-9f4b-2a85260660d8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:13.922035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9982c047-493f-47d8-9f4b-2a85260660d8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:13.922507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9982c047-493f-47d8-9f4b-2a85260660d8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:13.922926 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9982c047-493f-47d8-9f4b-2a85260660d8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:13.946118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-9982c047-493f-47d8-9f4b-2a85260660d8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lazy-loading 'flavor' on Instance uuid d64c75c4-9ba2-408f-8bbe-299f7888d6c9 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:47:14.064748 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-019ef9eb-acbb-46b3-bb7a-bc9f39940ecd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8aa63f3b-a417-4cae-b2b6-be30a14b2702"}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:47:14.067113 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-019ef9eb-acbb-46b3-bb7a-bc9f39940ecd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:14.073401 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-019ef9eb-acbb-46b3-bb7a-bc9f39940ecd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:14.074093 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-019ef9eb-acbb-46b3-bb7a-bc9f39940ecd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:14.074701 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-019ef9eb-acbb-46b3-bb7a-bc9f39940ecd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:14.075416 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-019ef9eb-acbb-46b3-bb7a-bc9f39940ecd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:14.075929 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-019ef9eb-acbb-46b3-bb7a-bc9f39940ecd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:14.076419 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-019ef9eb-acbb-46b3-bb7a-bc9f39940ecd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:14.137726 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9982c047-493f-47d8-9f4b-2a85260660d8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "POST /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9/action" status: 202 len: 0 microversion: 2.20 time: 0.235435 Aug 22 05:47:14.138442 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 396/804] 10.222.0.18 () {62 vars in 1319 bytes} [Mon Aug 22 05:47:13 2022] POST /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:47:14.147148 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b357faa8-1268-446e-9a6e-964f1b073305 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:14.147962 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b357faa8-1268-446e-9a6e-964f1b073305 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:14.154205 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b357faa8-1268-446e-9a6e-964f1b073305 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:14.154683 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b357faa8-1268-446e-9a6e-964f1b073305 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:14.155119 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b357faa8-1268-446e-9a6e-964f1b073305 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:14.156038 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b357faa8-1268-446e-9a6e-964f1b073305 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:14.156278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b357faa8-1268-446e-9a6e-964f1b073305 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:14.156888 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b357faa8-1268-446e-9a6e-964f1b073305 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:14.302535 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b357faa8-1268-446e-9a6e-964f1b073305 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:14.314414 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b357faa8-1268-446e-9a6e-964f1b073305 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:14.321114 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b357faa8-1268-446e-9a6e-964f1b073305 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:14.322691 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b357faa8-1268-446e-9a6e-964f1b073305 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1724 microversion: 2.20 time: 0.179797 Aug 22 05:47:14.324251 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 397/805] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:14 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 05:47:14.432960 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-019ef9eb-acbb-46b3-bb7a-bc9f39940ecd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "POST /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371643 Aug 22 05:47:14.433886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 409/806] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 22 05:47:14 2022] POST /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:47:15.351015 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-70354512-7f6c-4bf4-bbb5-a2155b310dfa tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:15.352004 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-70354512-7f6c-4bf4-bbb5-a2155b310dfa tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:15.360980 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70354512-7f6c-4bf4-bbb5-a2155b310dfa tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:15.361451 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70354512-7f6c-4bf4-bbb5-a2155b310dfa tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:15.361874 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70354512-7f6c-4bf4-bbb5-a2155b310dfa tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:15.362549 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70354512-7f6c-4bf4-bbb5-a2155b310dfa tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:15.363013 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70354512-7f6c-4bf4-bbb5-a2155b310dfa tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:15.363398 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70354512-7f6c-4bf4-bbb5-a2155b310dfa tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:15.501171 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-70354512-7f6c-4bf4-bbb5-a2155b310dfa tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:15.515603 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-70354512-7f6c-4bf4-bbb5-a2155b310dfa tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:15.517150 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-70354512-7f6c-4bf4-bbb5-a2155b310dfa tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:15.518448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-70354512-7f6c-4bf4-bbb5-a2155b310dfa tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1724 microversion: 2.20 time: 0.173822 Aug 22 05:47:15.520219 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 398/807] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:15 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:16.548273 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-82c6a0da-e171-47f2-b044-ea0582dcd668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:16.549358 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-82c6a0da-e171-47f2-b044-ea0582dcd668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:16.560393 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82c6a0da-e171-47f2-b044-ea0582dcd668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:16.560869 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82c6a0da-e171-47f2-b044-ea0582dcd668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:16.561329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82c6a0da-e171-47f2-b044-ea0582dcd668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:16.562015 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82c6a0da-e171-47f2-b044-ea0582dcd668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:16.562455 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82c6a0da-e171-47f2-b044-ea0582dcd668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:16.563055 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-82c6a0da-e171-47f2-b044-ea0582dcd668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:16.694975 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-82c6a0da-e171-47f2-b044-ea0582dcd668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:16.704113 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-82c6a0da-e171-47f2-b044-ea0582dcd668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:16.705602 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-82c6a0da-e171-47f2-b044-ea0582dcd668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:16.706752 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-82c6a0da-e171-47f2-b044-ea0582dcd668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1724 microversion: 2.20 time: 0.165831 Aug 22 05:47:16.707295 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 410/808] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:16 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:17.730384 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-63b03b65-5810-4b4e-b1af-57fdd83449fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:17.730962 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-63b03b65-5810-4b4e-b1af-57fdd83449fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:17.738535 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-63b03b65-5810-4b4e-b1af-57fdd83449fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:17.739007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-63b03b65-5810-4b4e-b1af-57fdd83449fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:17.739429 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-63b03b65-5810-4b4e-b1af-57fdd83449fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:17.740147 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-63b03b65-5810-4b4e-b1af-57fdd83449fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:17.740597 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-63b03b65-5810-4b4e-b1af-57fdd83449fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:17.741098 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-63b03b65-5810-4b4e-b1af-57fdd83449fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:17.879939 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-63b03b65-5810-4b4e-b1af-57fdd83449fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:17.888845 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-63b03b65-5810-4b4e-b1af-57fdd83449fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:17.890564 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-63b03b65-5810-4b4e-b1af-57fdd83449fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:17.891749 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-63b03b65-5810-4b4e-b1af-57fdd83449fb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1724 microversion: 2.20 time: 0.165268 Aug 22 05:47:17.892283 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 399/809] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:17 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:18.919811 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c750644f-a27c-4cbb-8d29-81250ce829b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:18.920509 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c750644f-a27c-4cbb-8d29-81250ce829b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:18.927342 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c750644f-a27c-4cbb-8d29-81250ce829b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:18.927865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c750644f-a27c-4cbb-8d29-81250ce829b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:18.928290 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c750644f-a27c-4cbb-8d29-81250ce829b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:18.928969 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c750644f-a27c-4cbb-8d29-81250ce829b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:18.929409 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c750644f-a27c-4cbb-8d29-81250ce829b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:18.929822 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c750644f-a27c-4cbb-8d29-81250ce829b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:19.067913 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c750644f-a27c-4cbb-8d29-81250ce829b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:19.076278 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c750644f-a27c-4cbb-8d29-81250ce829b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:19.078344 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c750644f-a27c-4cbb-8d29-81250ce829b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:19.079518 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c750644f-a27c-4cbb-8d29-81250ce829b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1724 microversion: 2.20 time: 0.163685 Aug 22 05:47:19.080117 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 411/810] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:18 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:20.109029 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a8889eba-b0cd-4812-98c0-008d61f38d3b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:20.109629 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a8889eba-b0cd-4812-98c0-008d61f38d3b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:20.116531 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a8889eba-b0cd-4812-98c0-008d61f38d3b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:20.117008 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a8889eba-b0cd-4812-98c0-008d61f38d3b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:20.117435 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a8889eba-b0cd-4812-98c0-008d61f38d3b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:20.118115 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a8889eba-b0cd-4812-98c0-008d61f38d3b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:20.118558 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a8889eba-b0cd-4812-98c0-008d61f38d3b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:20.118970 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a8889eba-b0cd-4812-98c0-008d61f38d3b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:20.251319 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a8889eba-b0cd-4812-98c0-008d61f38d3b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:20.259892 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a8889eba-b0cd-4812-98c0-008d61f38d3b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:20.261392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a8889eba-b0cd-4812-98c0-008d61f38d3b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:20.262541 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a8889eba-b0cd-4812-98c0-008d61f38d3b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1724 microversion: 2.20 time: 0.160131 Aug 22 05:47:20.263100 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 400/811] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:20 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:21.288908 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-04f9ffba-e7fc-4c37-b1af-b352a364f0dd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:21.289624 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-04f9ffba-e7fc-4c37-b1af-b352a364f0dd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:21.298600 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04f9ffba-e7fc-4c37-b1af-b352a364f0dd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:21.299236 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04f9ffba-e7fc-4c37-b1af-b352a364f0dd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:21.299857 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04f9ffba-e7fc-4c37-b1af-b352a364f0dd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:21.300763 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04f9ffba-e7fc-4c37-b1af-b352a364f0dd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:21.301357 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04f9ffba-e7fc-4c37-b1af-b352a364f0dd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:21.301916 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04f9ffba-e7fc-4c37-b1af-b352a364f0dd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:21.453714 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-04f9ffba-e7fc-4c37-b1af-b352a364f0dd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:21.462473 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-04f9ffba-e7fc-4c37-b1af-b352a364f0dd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:21.464395 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-04f9ffba-e7fc-4c37-b1af-b352a364f0dd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:21.465558 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-04f9ffba-e7fc-4c37-b1af-b352a364f0dd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1724 microversion: 2.20 time: 0.182143 Aug 22 05:47:21.466115 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 412/812] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:21 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:22.033086 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f59f41f9-d1f4-41e2-948a-d03f2bd25c6d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:22.035324 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f59f41f9-d1f4-41e2-948a-d03f2bd25c6d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:22.041965 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f59f41f9-d1f4-41e2-948a-d03f2bd25c6d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:22.042441 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f59f41f9-d1f4-41e2-948a-d03f2bd25c6d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:22.042869 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f59f41f9-d1f4-41e2-948a-d03f2bd25c6d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:22.043552 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f59f41f9-d1f4-41e2-948a-d03f2bd25c6d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:22.044035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f59f41f9-d1f4-41e2-948a-d03f2bd25c6d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:22.044448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f59f41f9-d1f4-41e2-948a-d03f2bd25c6d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:22.075899 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f59f41f9-d1f4-41e2-948a-d03f2bd25c6d tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048180 Aug 22 05:47:22.076420 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 401/813] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 22 05:47:22 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:47:22.226049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5bdf7480-53e2-48c2-940f-77f54d99a33b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:22.226429 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5bdf7480-53e2-48c2-940f-77f54d99a33b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:22.235893 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5bdf7480-53e2-48c2-940f-77f54d99a33b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:22.236545 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5bdf7480-53e2-48c2-940f-77f54d99a33b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:22.237099 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5bdf7480-53e2-48c2-940f-77f54d99a33b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:22.238125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5bdf7480-53e2-48c2-940f-77f54d99a33b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:22.238740 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5bdf7480-53e2-48c2-940f-77f54d99a33b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:22.239297 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5bdf7480-53e2-48c2-940f-77f54d99a33b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:22.272465 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5bdf7480-53e2-48c2-940f-77f54d99a33b tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments/7556309a-c1f4-48bd-b252-00bf4803ca16" status: 200 len: 194 microversion: 2.1 time: 0.052297 Aug 22 05:47:22.273035 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 413/814] 10.222.0.18 () {58 vars in 1413 bytes} [Mon Aug 22 05:47:22 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments/7556309a-c1f4-48bd-b252-00bf4803ca16 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:47:22.284392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e66760e8-afef-45ae-b2e7-7a5d20d03be5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:22.284885 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e66760e8-afef-45ae-b2e7-7a5d20d03be5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:22.291296 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e66760e8-afef-45ae-b2e7-7a5d20d03be5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:22.291830 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e66760e8-afef-45ae-b2e7-7a5d20d03be5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:22.292264 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e66760e8-afef-45ae-b2e7-7a5d20d03be5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:22.292956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e66760e8-afef-45ae-b2e7-7a5d20d03be5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:22.293411 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e66760e8-afef-45ae-b2e7-7a5d20d03be5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:22.293837 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e66760e8-afef-45ae-b2e7-7a5d20d03be5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:22.297932 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:47:22.385915 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-e66760e8-afef-45ae-b2e7-7a5d20d03be5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lazy-loading 'services' on Instance uuid 75fe69ea-b7a4-42f9-b222-4eea23123c62 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:47:22.464590 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e66760e8-afef-45ae-b2e7-7a5d20d03be5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "DELETE /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments/7556309a-c1f4-48bd-b252-00bf4803ca16" status: 202 len: 0 microversion: 2.1 time: 0.184206 Aug 22 05:47:22.465185 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 402/815] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 22 05:47:22 2022] DELETE /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments/7556309a-c1f4-48bd-b252-00bf4803ca16 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:47:22.489996 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8114483a-a499-4fce-bc7c-d7cda7d0ca97 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:22.491212 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8114483a-a499-4fce-bc7c-d7cda7d0ca97 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:22.498182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8114483a-a499-4fce-bc7c-d7cda7d0ca97 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:22.498671 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8114483a-a499-4fce-bc7c-d7cda7d0ca97 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:22.499147 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8114483a-a499-4fce-bc7c-d7cda7d0ca97 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:22.499869 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8114483a-a499-4fce-bc7c-d7cda7d0ca97 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:22.500308 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8114483a-a499-4fce-bc7c-d7cda7d0ca97 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:22.500993 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8114483a-a499-4fce-bc7c-d7cda7d0ca97 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:22.633060 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8114483a-a499-4fce-bc7c-d7cda7d0ca97 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:22.646865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8114483a-a499-4fce-bc7c-d7cda7d0ca97 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:22.649378 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8114483a-a499-4fce-bc7c-d7cda7d0ca97 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:22.651200 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8114483a-a499-4fce-bc7c-d7cda7d0ca97 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1724 microversion: 2.20 time: 0.165080 Aug 22 05:47:22.652195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 414/816] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:22 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:23.598066 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a7d2323e-01f4-4246-a578-77f107bfaf72 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:23.598634 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a7d2323e-01f4-4246-a578-77f107bfaf72 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:23.605013 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a7d2323e-01f4-4246-a578-77f107bfaf72 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:23.605484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a7d2323e-01f4-4246-a578-77f107bfaf72 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:23.605912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a7d2323e-01f4-4246-a578-77f107bfaf72 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:23.606589 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a7d2323e-01f4-4246-a578-77f107bfaf72 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:23.607029 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a7d2323e-01f4-4246-a578-77f107bfaf72 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:23.607451 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a7d2323e-01f4-4246-a578-77f107bfaf72 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:23.643486 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a7d2323e-01f4-4246-a578-77f107bfaf72 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments/8aa63f3b-a417-4cae-b2b6-be30a14b2702" status: 200 len: 194 microversion: 2.1 time: 0.051934 Aug 22 05:47:23.644750 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 403/817] 10.222.0.18 () {58 vars in 1413 bytes} [Mon Aug 22 05:47:23 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments/8aa63f3b-a417-4cae-b2b6-be30a14b2702 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:47:23.655515 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b713e52a-58f3-4eea-9441-b8166faa7b1a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:23.656000 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b713e52a-58f3-4eea-9441-b8166faa7b1a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:23.663345 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b713e52a-58f3-4eea-9441-b8166faa7b1a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:23.663853 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b713e52a-58f3-4eea-9441-b8166faa7b1a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:23.664282 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b713e52a-58f3-4eea-9441-b8166faa7b1a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:23.664959 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b713e52a-58f3-4eea-9441-b8166faa7b1a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:23.665397 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b713e52a-58f3-4eea-9441-b8166faa7b1a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:23.665808 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b713e52a-58f3-4eea-9441-b8166faa7b1a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:23.674219 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-55c74950-56ad-49bf-89c7-5758a3a43462 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:23.674821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-55c74950-56ad-49bf-89c7-5758a3a43462 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:23.681266 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-55c74950-56ad-49bf-89c7-5758a3a43462 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:23.681768 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-55c74950-56ad-49bf-89c7-5758a3a43462 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:23.682166 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-55c74950-56ad-49bf-89c7-5758a3a43462 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:23.682841 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-55c74950-56ad-49bf-89c7-5758a3a43462 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:23.683287 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-55c74950-56ad-49bf-89c7-5758a3a43462 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:23.683731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-55c74950-56ad-49bf-89c7-5758a3a43462 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:23.752278 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.objects.instance [None req-b713e52a-58f3-4eea-9441-b8166faa7b1a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lazy-loading 'services' on Instance uuid 75fe69ea-b7a4-42f9-b222-4eea23123c62 {{(pid=132497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:47:23.824727 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-55c74950-56ad-49bf-89c7-5758a3a43462 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:23.825027 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b713e52a-58f3-4eea-9441-b8166faa7b1a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "DELETE /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments/8aa63f3b-a417-4cae-b2b6-be30a14b2702" status: 202 len: 0 microversion: 2.1 time: 0.173376 Aug 22 05:47:23.825624 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 415/818] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 22 05:47:23 2022] DELETE /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments/8aa63f3b-a417-4cae-b2b6-be30a14b2702 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:47:23.833681 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-55c74950-56ad-49bf-89c7-5758a3a43462 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:23.835173 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-55c74950-56ad-49bf-89c7-5758a3a43462 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:23.836361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-55c74950-56ad-49bf-89c7-5758a3a43462 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1724 microversion: 2.20 time: 0.166073 Aug 22 05:47:23.851781 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 404/819] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:23 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:24.861198 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-96e6d9f2-f01b-45a8-b902-3ff31cb3f4b3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:24.861885 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-96e6d9f2-f01b-45a8-b902-3ff31cb3f4b3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:24.868511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-96e6d9f2-f01b-45a8-b902-3ff31cb3f4b3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:24.868987 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-96e6d9f2-f01b-45a8-b902-3ff31cb3f4b3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:24.869421 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-96e6d9f2-f01b-45a8-b902-3ff31cb3f4b3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:24.870106 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-96e6d9f2-f01b-45a8-b902-3ff31cb3f4b3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:24.870550 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-96e6d9f2-f01b-45a8-b902-3ff31cb3f4b3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:24.870971 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-96e6d9f2-f01b-45a8-b902-3ff31cb3f4b3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:25.006149 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-96e6d9f2-f01b-45a8-b902-3ff31cb3f4b3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:25.008055 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-56b542f4-55b0-43f8-a637-4825357c26c5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:25.010286 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-56b542f4-55b0-43f8-a637-4825357c26c5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:25.014106 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-96e6d9f2-f01b-45a8-b902-3ff31cb3f4b3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:25.015611 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-96e6d9f2-f01b-45a8-b902-3ff31cb3f4b3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:25.016749 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-96e6d9f2-f01b-45a8-b902-3ff31cb3f4b3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1724 microversion: 2.20 time: 0.160422 Aug 22 05:47:25.016873 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56b542f4-55b0-43f8-a637-4825357c26c5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:25.017275 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56b542f4-55b0-43f8-a637-4825357c26c5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:25.017404 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 416/820] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:24 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:25.017703 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56b542f4-55b0-43f8-a637-4825357c26c5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:25.018467 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56b542f4-55b0-43f8-a637-4825357c26c5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:25.018906 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56b542f4-55b0-43f8-a637-4825357c26c5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:25.019737 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56b542f4-55b0-43f8-a637-4825357c26c5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:25.050066 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-56b542f4-55b0-43f8-a637-4825357c26c5 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046533 Aug 22 05:47:25.050683 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 405/821] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 22 05:47:25 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 05:47:25.171215 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a4e258ec-a045-4f0e-9bcf-ccb59012e248 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:25.175353 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a4e258ec-a045-4f0e-9bcf-ccb59012e248 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:25.182051 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a4e258ec-a045-4f0e-9bcf-ccb59012e248 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:25.182534 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a4e258ec-a045-4f0e-9bcf-ccb59012e248 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:25.182966 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a4e258ec-a045-4f0e-9bcf-ccb59012e248 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:25.183667 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a4e258ec-a045-4f0e-9bcf-ccb59012e248 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:25.184118 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a4e258ec-a045-4f0e-9bcf-ccb59012e248 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:25.184539 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a4e258ec-a045-4f0e-9bcf-ccb59012e248 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:25.215229 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a4e258ec-a045-4f0e-9bcf-ccb59012e248 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050914 Aug 22 05:47:25.215796 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 417/822] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 22 05:47:25 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 05:47:25.276810 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-cbf7ad91-86e9-486e-af67-2082c7cadd94 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:25.277298 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-cbf7ad91-86e9-486e-af67-2082c7cadd94 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:25.283611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cbf7ad91-86e9-486e-af67-2082c7cadd94 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:25.284124 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cbf7ad91-86e9-486e-af67-2082c7cadd94 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:25.284548 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cbf7ad91-86e9-486e-af67-2082c7cadd94 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:25.285293 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cbf7ad91-86e9-486e-af67-2082c7cadd94 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:25.285828 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cbf7ad91-86e9-486e-af67-2082c7cadd94 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:25.286238 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cbf7ad91-86e9-486e-af67-2082c7cadd94 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:25.310326 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-cbf7ad91-86e9-486e-af67-2082c7cadd94 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:47:25.392354 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-cbf7ad91-86e9-486e-af67-2082c7cadd94 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "DELETE /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 204 len: 0 microversion: 2.1 time: 0.119115 Aug 22 05:47:25.392942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 406/823] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:47:25 2022] DELETE /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:47:25.401472 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5358a72c-3fab-4709-b196-550f1337541a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:25.402071 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5358a72c-3fab-4709-b196-550f1337541a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:25.407936 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5358a72c-3fab-4709-b196-550f1337541a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:25.408399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5358a72c-3fab-4709-b196-550f1337541a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:25.408818 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5358a72c-3fab-4709-b196-550f1337541a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:25.409502 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5358a72c-3fab-4709-b196-550f1337541a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:25.409973 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5358a72c-3fab-4709-b196-550f1337541a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:25.410566 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5358a72c-3fab-4709-b196-550f1337541a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:25.540204 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5358a72c-3fab-4709-b196-550f1337541a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:25.548039 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5358a72c-3fab-4709-b196-550f1337541a tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 200 len: 1674 microversion: 2.1 time: 0.150438 Aug 22 05:47:25.548607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 418/824] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:25 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:47:26.040228 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-71f6fb7f-edb3-45ae-a87e-dfc9847087d7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:26.040946 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-71f6fb7f-edb3-45ae-a87e-dfc9847087d7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:26.048026 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71f6fb7f-edb3-45ae-a87e-dfc9847087d7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:26.048510 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71f6fb7f-edb3-45ae-a87e-dfc9847087d7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:26.048938 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71f6fb7f-edb3-45ae-a87e-dfc9847087d7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:26.049626 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71f6fb7f-edb3-45ae-a87e-dfc9847087d7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:26.050071 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71f6fb7f-edb3-45ae-a87e-dfc9847087d7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:26.050574 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71f6fb7f-edb3-45ae-a87e-dfc9847087d7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:26.194404 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-71f6fb7f-edb3-45ae-a87e-dfc9847087d7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:26.207512 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-71f6fb7f-edb3-45ae-a87e-dfc9847087d7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:26.208964 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-71f6fb7f-edb3-45ae-a87e-dfc9847087d7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:26.210097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-71f6fb7f-edb3-45ae-a87e-dfc9847087d7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1724 microversion: 2.20 time: 0.174317 Aug 22 05:47:26.210653 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 407/825] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:26 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:26.574365 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-232cb532-f791-4b3f-b482-901188e57324 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:26.575218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-232cb532-f791-4b3f-b482-901188e57324 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:26.586018 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-232cb532-f791-4b3f-b482-901188e57324 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:26.587259 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-232cb532-f791-4b3f-b482-901188e57324 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:26.588023 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-232cb532-f791-4b3f-b482-901188e57324 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:26.589493 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-232cb532-f791-4b3f-b482-901188e57324 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:26.590232 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-232cb532-f791-4b3f-b482-901188e57324 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:26.590917 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-232cb532-f791-4b3f-b482-901188e57324 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:26.598064 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:47:26.730881 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-232cb532-f791-4b3f-b482-901188e57324 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:26.742722 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-232cb532-f791-4b3f-b482-901188e57324 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 200 len: 1674 microversion: 2.1 time: 0.175392 Aug 22 05:47:26.743799 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 419/826] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:26 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:47:27.238804 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b6abbc4e-9bb5-4aee-9370-d64d92732417 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:27.239412 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b6abbc4e-9bb5-4aee-9370-d64d92732417 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:27.246329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b6abbc4e-9bb5-4aee-9370-d64d92732417 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:27.246807 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b6abbc4e-9bb5-4aee-9370-d64d92732417 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:27.247235 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b6abbc4e-9bb5-4aee-9370-d64d92732417 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:27.247960 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b6abbc4e-9bb5-4aee-9370-d64d92732417 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:27.248403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b6abbc4e-9bb5-4aee-9370-d64d92732417 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:27.248839 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b6abbc4e-9bb5-4aee-9370-d64d92732417 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:27.389266 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b6abbc4e-9bb5-4aee-9370-d64d92732417 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:27.398251 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b6abbc4e-9bb5-4aee-9370-d64d92732417 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:27.399890 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b6abbc4e-9bb5-4aee-9370-d64d92732417 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:27.401035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b6abbc4e-9bb5-4aee-9370-d64d92732417 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1724 microversion: 2.20 time: 0.166477 Aug 22 05:47:27.401601 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 408/827] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:27 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:27.767197 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e2bffbc6-07e4-4d34-a43d-93eda7f1ed03 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:27.767837 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e2bffbc6-07e4-4d34-a43d-93eda7f1ed03 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:27.775820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2bffbc6-07e4-4d34-a43d-93eda7f1ed03 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:27.776369 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2bffbc6-07e4-4d34-a43d-93eda7f1ed03 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:27.776818 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2bffbc6-07e4-4d34-a43d-93eda7f1ed03 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:27.777497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2bffbc6-07e4-4d34-a43d-93eda7f1ed03 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:27.778919 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2bffbc6-07e4-4d34-a43d-93eda7f1ed03 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:27.779348 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e2bffbc6-07e4-4d34-a43d-93eda7f1ed03 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:27.924413 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e2bffbc6-07e4-4d34-a43d-93eda7f1ed03 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:27.933126 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e2bffbc6-07e4-4d34-a43d-93eda7f1ed03 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 200 len: 1674 microversion: 2.1 time: 0.169663 Aug 22 05:47:27.933708 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 420/828] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:27 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:47:28.424666 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b89c7a9f-4610-4397-b98f-9a6d5a641bca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:28.425349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b89c7a9f-4610-4397-b98f-9a6d5a641bca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:28.432604 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b89c7a9f-4610-4397-b98f-9a6d5a641bca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:28.433328 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b89c7a9f-4610-4397-b98f-9a6d5a641bca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:28.433657 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b89c7a9f-4610-4397-b98f-9a6d5a641bca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:28.434406 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b89c7a9f-4610-4397-b98f-9a6d5a641bca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:28.435001 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b89c7a9f-4610-4397-b98f-9a6d5a641bca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:28.435447 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b89c7a9f-4610-4397-b98f-9a6d5a641bca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:28.572802 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b89c7a9f-4610-4397-b98f-9a6d5a641bca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:28.581175 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b89c7a9f-4610-4397-b98f-9a6d5a641bca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:28.582678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b89c7a9f-4610-4397-b98f-9a6d5a641bca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:28.583859 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b89c7a9f-4610-4397-b98f-9a6d5a641bca tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1724 microversion: 2.20 time: 0.163129 Aug 22 05:47:28.584563 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 409/829] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:28 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:28.773033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-50b04718-2247-4af8-8889-9d96875e6242 req-cd87a9a4-7223-45d2-aa1a-e9b8eeb89fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75fe69ea-b7a4-42f9-b222-4eea23123c62", "name": "network-vif-deleted", "tag": "83c31f1b-d8da-4975-a21b-2e8a4c789571"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:47:28.783546 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-50b04718-2247-4af8-8889-9d96875e6242 req-cd87a9a4-7223-45d2-aa1a-e9b8eeb89fcd service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:28.784051 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-50b04718-2247-4af8-8889-9d96875e6242 req-cd87a9a4-7223-45d2-aa1a-e9b8eeb89fcd service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:28.784470 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-50b04718-2247-4af8-8889-9d96875e6242 req-cd87a9a4-7223-45d2-aa1a-e9b8eeb89fcd service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:28.796937 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-50b04718-2247-4af8-8889-9d96875e6242 req-cd87a9a4-7223-45d2-aa1a-e9b8eeb89fcd service nova] Creating event network-vif-deleted:83c31f1b-d8da-4975-a21b-2e8a4c789571 for instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 on hv-cinder-85391 Aug 22 05:47:28.802876 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-50b04718-2247-4af8-8889-9d96875e6242 req-cd87a9a4-7223-45d2-aa1a-e9b8eeb89fcd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034032 Aug 22 05:47:28.803491 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 421/830] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:47:28.955544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f7415044-0911-49ee-a0f0-1ff18ed4f775 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:28.956185 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f7415044-0911-49ee-a0f0-1ff18ed4f775 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:28.962677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f7415044-0911-49ee-a0f0-1ff18ed4f775 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:28.963531 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f7415044-0911-49ee-a0f0-1ff18ed4f775 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:28.964095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f7415044-0911-49ee-a0f0-1ff18ed4f775 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:28.964798 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f7415044-0911-49ee-a0f0-1ff18ed4f775 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:28.965293 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f7415044-0911-49ee-a0f0-1ff18ed4f775 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:28.965704 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f7415044-0911-49ee-a0f0-1ff18ed4f775 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:28.998746 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f7415044-0911-49ee-a0f0-1ff18ed4f775 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:28.999700 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f7415044-0911-49ee-a0f0-1ff18ed4f775 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:28.999700 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f7415044-0911-49ee-a0f0-1ff18ed4f775 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:29.000118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-f7415044-0911-49ee-a0f0-1ff18ed4f775 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lazy-loading 'fault' on Instance uuid 75fe69ea-b7a4-42f9-b222-4eea23123c62 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:47:29.053345 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f7415044-0911-49ee-a0f0-1ff18ed4f775 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e68f520aaff495abfb4b7a5271936e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8481f1683045d4a63b3d33e0dab620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:29.061678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f7415044-0911-49ee-a0f0-1ff18ed4f775 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 200 len: 1328 microversion: 2.1 time: 0.110292 Aug 22 05:47:29.062309 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 410/831] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:28 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:47:29.608413 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-26f1779e-c01c-4392-8904-e9d0480c2cb1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:29.609111 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-26f1779e-c01c-4392-8904-e9d0480c2cb1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:29.615552 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26f1779e-c01c-4392-8904-e9d0480c2cb1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:29.616148 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26f1779e-c01c-4392-8904-e9d0480c2cb1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:29.616578 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26f1779e-c01c-4392-8904-e9d0480c2cb1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:29.617276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26f1779e-c01c-4392-8904-e9d0480c2cb1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:29.617724 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26f1779e-c01c-4392-8904-e9d0480c2cb1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:29.618142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26f1779e-c01c-4392-8904-e9d0480c2cb1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:29.758437 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-26f1779e-c01c-4392-8904-e9d0480c2cb1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:29.766926 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-26f1779e-c01c-4392-8904-e9d0480c2cb1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:29.768536 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-26f1779e-c01c-4392-8904-e9d0480c2cb1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:29.769782 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-26f1779e-c01c-4392-8904-e9d0480c2cb1 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1724 microversion: 2.20 time: 0.165807 Aug 22 05:47:29.770445 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 422/832] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:29 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:30.088474 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c08c70c3-c9a5-4c94-8fc5-54cd9f563f7c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:30.089336 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c08c70c3-c9a5-4c94-8fc5-54cd9f563f7c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:30.093107 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:47:30.100480 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c08c70c3-c9a5-4c94-8fc5-54cd9f563f7c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:30.100966 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c08c70c3-c9a5-4c94-8fc5-54cd9f563f7c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:30.101400 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c08c70c3-c9a5-4c94-8fc5-54cd9f563f7c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:30.102085 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c08c70c3-c9a5-4c94-8fc5-54cd9f563f7c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:30.102544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c08c70c3-c9a5-4c94-8fc5-54cd9f563f7c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:30.102965 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c08c70c3-c9a5-4c94-8fc5-54cd9f563f7c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:30.118139 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-c08c70c3-c9a5-4c94-8fc5-54cd9f563f7c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] HTTP exception thrown: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c08c70c3-c9a5-4c94-8fc5-54cd9f563f7c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Request method failure captured: Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 HTTP/1.1 Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxZNuMuH7w1Aa8XfSCRYyOCz_1_XfsSPHd6uxxEn6WlNYcUmt26Dwsor1l__QiX2FoHdUn46tPS4lmQgwKZxFbEFawOKMGHu7GnvOmxAWqbGPbJz35XLAkIDC19Lgn_hIX0KhQTO7VqzyUKXmawvOB7NBBbS9yLAb6KZQt29Ndb0vkk Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 8e8481f1683045d4a63b3d33e0dab620 Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:47:30.119821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:47:30.121361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8e8481f1683045d4a63b3d33e0dab620", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:47:30.121361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:47:30.121361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 8e8481f1683045d4a63b3d33e0dab620 Aug 22 05:47:30.121361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:47:30.121361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeTestJSON-1597267240-project Aug 22 05:47:30.121361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:47:30.121361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:47:30.121361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 8e68f520aaff495abfb4b7a5271936e1 Aug 22 05:47:30.121361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeTestJSON-1597267240-project Aug 22 05:47:30.121361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:47:30.121361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. Aug 22 05:47:30.121361 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '75fe69ea-b7a4-42f9-b222-4eea23123c62'} Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:47:30.122301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. Aug 22 05:47:30.123785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:30.125083 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c08c70c3-c9a5-4c94-8fc5-54cd9f563f7c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Returning 404 to user: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:47:30.125083 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c08c70c3-c9a5-4c94-8fc5-54cd9f563f7c tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 404 len: 111 microversion: 2.1 time: 0.039985 Aug 22 05:47:30.125083 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 411/833] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:30 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:47:30.131502 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e5b8b506-4caa-4c88-a3d5-d94e7cf2b758 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '.version_select at 0x7f0b3df20670>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:30.138537 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:47:30.153526 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e5b8b506-4caa-4c88-a3d5-d94e7cf2b758 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096199609" status: 202 len: 0 microversion: 2.1 time: 0.026721 Aug 22 05:47:30.154087 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 423/834] 10.222.0.18 () {58 vars in 1221 bytes} [Mon Aug 22 05:47:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096199609 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:47:30.793377 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-dbaa0944-b30f-4692-937c-13d97c0a3d1d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:30.793634 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-dbaa0944-b30f-4692-937c-13d97c0a3d1d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:30.799748 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dbaa0944-b30f-4692-937c-13d97c0a3d1d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:30.800229 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dbaa0944-b30f-4692-937c-13d97c0a3d1d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:30.800907 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dbaa0944-b30f-4692-937c-13d97c0a3d1d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:30.802062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dbaa0944-b30f-4692-937c-13d97c0a3d1d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:30.802513 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dbaa0944-b30f-4692-937c-13d97c0a3d1d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:30.802941 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dbaa0944-b30f-4692-937c-13d97c0a3d1d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:30.941628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-dbaa0944-b30f-4692-937c-13d97c0a3d1d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:30.949952 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-dbaa0944-b30f-4692-937c-13d97c0a3d1d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:30.951364 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-dbaa0944-b30f-4692-937c-13d97c0a3d1d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:30.952563 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-dbaa0944-b30f-4692-937c-13d97c0a3d1d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1745 microversion: 2.20 time: 0.163670 Aug 22 05:47:30.953109 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 412/835] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:30 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:31.976905 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4074dca5-f5d4-4168-89db-db87262e4172 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:31.977498 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4074dca5-f5d4-4168-89db-db87262e4172 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:31.984977 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4074dca5-f5d4-4168-89db-db87262e4172 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:31.985763 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4074dca5-f5d4-4168-89db-db87262e4172 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:31.986426 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4074dca5-f5d4-4168-89db-db87262e4172 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:31.987375 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4074dca5-f5d4-4168-89db-db87262e4172 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:31.987957 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4074dca5-f5d4-4168-89db-db87262e4172 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:31.988784 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4074dca5-f5d4-4168-89db-db87262e4172 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:32.134292 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4074dca5-f5d4-4168-89db-db87262e4172 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:32.142733 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4074dca5-f5d4-4168-89db-db87262e4172 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:32.144666 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4074dca5-f5d4-4168-89db-db87262e4172 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:32.145942 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4074dca5-f5d4-4168-89db-db87262e4172 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1745 microversion: 2.20 time: 0.173395 Aug 22 05:47:32.146837 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 424/836] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:31 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:33.095826 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e869b21e-4434-4bd6-b61e-5933760122c2 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:33.096371 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e869b21e-4434-4bd6-b61e-5933760122c2 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:33.103467 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e869b21e-4434-4bd6-b61e-5933760122c2 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:33.103991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e869b21e-4434-4bd6-b61e-5933760122c2 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:33.104425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e869b21e-4434-4bd6-b61e-5933760122c2 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:33.105112 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e869b21e-4434-4bd6-b61e-5933760122c2 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:33.105559 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e869b21e-4434-4bd6-b61e-5933760122c2 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:33.105982 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e869b21e-4434-4bd6-b61e-5933760122c2 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:33.119430 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-e869b21e-4434-4bd6-b61e-5933760122c2 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] HTTP exception thrown: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e869b21e-4434-4bd6-b61e-5933760122c2 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Request method failure captured: Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: DELETE /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 HTTP/1.1 Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxZNuMuH7w1Aa8XfSCRYyOCz_1_XfsSPHd6uxxEn6WlNYcUmt26Dwsor1l__QiX2FoHdUn46tPS4lmQgwKZxFbEFawOKMGHu7GnvOmxAWqbGPbJz35XLAkIDC19Lgn_hIX0KhQTO7VqzyUKXmawvOB7NBBbS9yLAb6KZQt29Ndb0vkk Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 8e8481f1683045d4a63b3d33e0dab620 Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:47:33.121007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:47:33.122553 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8e8481f1683045d4a63b3d33e0dab620", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:47:33.122553 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:47:33.122553 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 8e8481f1683045d4a63b3d33e0dab620 Aug 22 05:47:33.122553 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:47:33.122553 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeTestJSON-1597267240-project Aug 22 05:47:33.122553 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:47:33.122553 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:47:33.122553 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 8e68f520aaff495abfb4b7a5271936e1 Aug 22 05:47:33.122553 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeTestJSON-1597267240-project Aug 22 05:47:33.122553 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:47:33.122553 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. Aug 22 05:47:33.122553 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '75fe69ea-b7a4-42f9-b222-4eea23123c62'} Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:47:33.123838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. Aug 22 05:47:33.126570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:33.129457 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e869b21e-4434-4bd6-b61e-5933760122c2 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Returning 404 to user: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:47:33.129457 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e869b21e-4434-4bd6-b61e-5933760122c2 tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "DELETE /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 404 len: 111 microversion: 2.1 time: 0.030963 Aug 22 05:47:33.129457 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 413/837] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:47:33 2022] DELETE /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:47:33.131121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b15a0eb7-d80c-4222-a324-b1063b94a04e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:33.131752 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b15a0eb7-d80c-4222-a324-b1063b94a04e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 75fe69ea-b7a4-42f9-b222-4eea23123c62] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:33.138536 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b15a0eb7-d80c-4222-a324-b1063b94a04e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:33.139007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b15a0eb7-d80c-4222-a324-b1063b94a04e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:33.139435 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b15a0eb7-d80c-4222-a324-b1063b94a04e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:33.140165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b15a0eb7-d80c-4222-a324-b1063b94a04e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:33.140607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b15a0eb7-d80c-4222-a324-b1063b94a04e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:33.141020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b15a0eb7-d80c-4222-a324-b1063b94a04e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:33.155304 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-b15a0eb7-d80c-4222-a324-b1063b94a04e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] HTTP exception thrown: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b15a0eb7-d80c-4222-a324-b1063b94a04e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Request method failure captured: Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 HTTP/1.1 Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxZNuMuH7w1Aa8XfSCRYyOCz_1_XfsSPHd6uxxEn6WlNYcUmt26Dwsor1l__QiX2FoHdUn46tPS4lmQgwKZxFbEFawOKMGHu7GnvOmxAWqbGPbJz35XLAkIDC19Lgn_hIX0KhQTO7VqzyUKXmawvOB7NBBbS9yLAb6KZQt29Ndb0vkk Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: 8e8481f1683045d4a63b3d33e0dab620 Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:47:33.156925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:47:33.158553 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8e8481f1683045d4a63b3d33e0dab620", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:47:33.158553 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:47:33.158553 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: 8e8481f1683045d4a63b3d33e0dab620 Aug 22 05:47:33.158553 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:47:33.158553 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-AttachVolumeTestJSON-1597267240-project Aug 22 05:47:33.158553 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:47:33.158553 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:47:33.158553 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: 8e68f520aaff495abfb4b7a5271936e1 Aug 22 05:47:33.158553 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-AttachVolumeTestJSON-1597267240-project Aug 22 05:47:33.158553 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:47:33.158553 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. Aug 22 05:47:33.158553 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': '75fe69ea-b7a4-42f9-b222-4eea23123c62'} Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:47:33.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. Aug 22 05:47:33.161270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:47:33.162717 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b15a0eb7-d80c-4222-a324-b1063b94a04e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Returning 404 to user: Instance 75fe69ea-b7a4-42f9-b222-4eea23123c62 could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:47:33.162717 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b15a0eb7-d80c-4222-a324-b1063b94a04e tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62" status: 404 len: 111 microversion: 2.1 time: 0.031113 Aug 22 05:47:33.162717 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 425/838] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:33 2022] GET /compute/v2.1/servers/75fe69ea-b7a4-42f9-b222-4eea23123c62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:47:33.176675 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-94ce4a8e-fe3e-46aa-b172-4fcc32cbd387 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:33.177315 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-94ce4a8e-fe3e-46aa-b172-4fcc32cbd387 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:33.183703 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94ce4a8e-fe3e-46aa-b172-4fcc32cbd387 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:33.184164 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94ce4a8e-fe3e-46aa-b172-4fcc32cbd387 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:33.184613 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94ce4a8e-fe3e-46aa-b172-4fcc32cbd387 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:33.185314 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94ce4a8e-fe3e-46aa-b172-4fcc32cbd387 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:33.185744 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94ce4a8e-fe3e-46aa-b172-4fcc32cbd387 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:33.186178 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94ce4a8e-fe3e-46aa-b172-4fcc32cbd387 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:33.319402 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-94ce4a8e-fe3e-46aa-b172-4fcc32cbd387 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:33.327559 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-94ce4a8e-fe3e-46aa-b172-4fcc32cbd387 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:33.329052 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-94ce4a8e-fe3e-46aa-b172-4fcc32cbd387 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:33.330173 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-94ce4a8e-fe3e-46aa-b172-4fcc32cbd387 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1745 microversion: 2.20 time: 0.159703 Aug 22 05:47:33.330724 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 414/839] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:33 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:33.852309 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-cf13b467-e4b1-4dd1-8fa1-9beee8601d28 req-2c993c29-e221-4d22-b1d3-b780eaa1b56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64c75c4-9ba2-408f-8bbe-299f7888d6c9", "name": "network-vif-plugged", "status": "completed", "tag": "3a3f4de9-615b-4419-87d6-e78feae8eeda"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:47:33.862965 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-cf13b467-e4b1-4dd1-8fa1-9beee8601d28 req-2c993c29-e221-4d22-b1d3-b780eaa1b56c service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:33.863437 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-cf13b467-e4b1-4dd1-8fa1-9beee8601d28 req-2c993c29-e221-4d22-b1d3-b780eaa1b56c service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:33.864606 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-cf13b467-e4b1-4dd1-8fa1-9beee8601d28 req-2c993c29-e221-4d22-b1d3-b780eaa1b56c service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:33.876460 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-cf13b467-e4b1-4dd1-8fa1-9beee8601d28 req-2c993c29-e221-4d22-b1d3-b780eaa1b56c service nova] Creating event network-vif-plugged:3a3f4de9-615b-4419-87d6-e78feae8eeda for instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 on hv-cinder-85391 Aug 22 05:47:33.881661 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-cf13b467-e4b1-4dd1-8fa1-9beee8601d28 req-2c993c29-e221-4d22-b1d3-b780eaa1b56c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033454 Aug 22 05:47:33.882515 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 426/840] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:47:34.319080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3fbdb4d3-9b91-48c4-b8de-a6d3721e3acd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:34.319761 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3fbdb4d3-9b91-48c4-b8de-a6d3721e3acd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:34.327836 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3fbdb4d3-9b91-48c4-b8de-a6d3721e3acd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:34.328633 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3fbdb4d3-9b91-48c4-b8de-a6d3721e3acd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:34.329120 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3fbdb4d3-9b91-48c4-b8de-a6d3721e3acd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:34.330213 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3fbdb4d3-9b91-48c4-b8de-a6d3721e3acd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:34.330567 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3fbdb4d3-9b91-48c4-b8de-a6d3721e3acd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:34.331001 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3fbdb4d3-9b91-48c4-b8de-a6d3721e3acd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:34.345950 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-3fbdb4d3-9b91-48c4-b8de-a6d3721e3acd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] HTTP exception thrown: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3fbdb4d3-9b91-48c4-b8de-a6d3721e3acd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Request method failure captured: Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: DELETE /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 HTTP/1.1 Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxZNuMuH7w1Aa8XfSCRYyOCz_1_XfsSPHd6uxxEn6WlNYcUmt26Dwsor1l__QiX2FoHdUn46tPS4lmQgwKZxFbEFawOKMGHu7GnvOmxAWqbGPbJz35XLAkIDC19Lgn_hIX0KhQTO7VqzyUKXmawvOB7NBBbS9yLAb6KZQt29Ndb0vkk Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 8e8481f1683045d4a63b3d33e0dab620 Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:47:34.347545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:47:34.350095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8e8481f1683045d4a63b3d33e0dab620", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:47:34.350095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:47:34.350095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 8e8481f1683045d4a63b3d33e0dab620 Aug 22 05:47:34.350095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:47:34.350095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeTestJSON-1597267240-project Aug 22 05:47:34.350095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:47:34.350095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:47:34.350095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 8e68f520aaff495abfb4b7a5271936e1 Aug 22 05:47:34.350095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeTestJSON-1597267240-project Aug 22 05:47:34.350095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:47:34.350095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. Aug 22 05:47:34.350095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '585fdc4d-a711-4748-9480-bb5a9bab88f4'} Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:47:34.351082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. Aug 22 05:47:34.352544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:34.353836 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3fbdb4d3-9b91-48c4-b8de-a6d3721e3acd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Returning 404 to user: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:47:34.353836 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3fbdb4d3-9b91-48c4-b8de-a6d3721e3acd tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "DELETE /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 404 len: 111 microversion: 2.1 time: 0.035669 Aug 22 05:47:34.353836 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 415/841] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:47:34 2022] DELETE /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:47:34.355834 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-78fddbc1-69d6-4b79-843b-aff3042a44f5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:34.356526 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-78fddbc1-69d6-4b79-843b-aff3042a44f5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:34.357821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-00cd5b31-52ed-4471-86c8-0d1d877641ea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:34.358491 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-00cd5b31-52ed-4471-86c8-0d1d877641ea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] [instance: 585fdc4d-a711-4748-9480-bb5a9bab88f4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:34.363594 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-78fddbc1-69d6-4b79-843b-aff3042a44f5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:34.364219 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-78fddbc1-69d6-4b79-843b-aff3042a44f5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:34.364632 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00cd5b31-52ed-4471-86c8-0d1d877641ea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:34.364795 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-78fddbc1-69d6-4b79-843b-aff3042a44f5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:34.365119 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00cd5b31-52ed-4471-86c8-0d1d877641ea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:34.366008 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-78fddbc1-69d6-4b79-843b-aff3042a44f5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:34.366154 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00cd5b31-52ed-4471-86c8-0d1d877641ea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:34.366267 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-78fddbc1-69d6-4b79-843b-aff3042a44f5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:34.366362 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00cd5b31-52ed-4471-86c8-0d1d877641ea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:34.366466 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-78fddbc1-69d6-4b79-843b-aff3042a44f5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:34.366780 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00cd5b31-52ed-4471-86c8-0d1d877641ea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:34.367185 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-00cd5b31-52ed-4471-86c8-0d1d877641ea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:34.380804 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-00cd5b31-52ed-4471-86c8-0d1d877641ea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] HTTP exception thrown: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-00cd5b31-52ed-4471-86c8-0d1d877641ea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Request method failure captured: Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 HTTP/1.1 Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxZNuMuH7w1Aa8XfSCRYyOCz_1_XfsSPHd6uxxEn6WlNYcUmt26Dwsor1l__QiX2FoHdUn46tPS4lmQgwKZxFbEFawOKMGHu7GnvOmxAWqbGPbJz35XLAkIDC19Lgn_hIX0KhQTO7VqzyUKXmawvOB7NBBbS9yLAb6KZQt29Ndb0vkk Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 8e8481f1683045d4a63b3d33e0dab620 Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:47:34.382329 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:47:34.384209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8e8481f1683045d4a63b3d33e0dab620", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8e8481f1683045d4a63b3d33e0dab620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:47:34.384209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:47:34.384209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 8e8481f1683045d4a63b3d33e0dab620 Aug 22 05:47:34.384209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1597267240 Aug 22 05:47:34.384209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeTestJSON-1597267240-project Aug 22 05:47:34.384209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:47:34.384209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:47:34.384209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 8e68f520aaff495abfb4b7a5271936e1 Aug 22 05:47:34.384209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeTestJSON-1597267240-project Aug 22 05:47:34.384209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:47:34.384209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. Aug 22 05:47:34.384209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '585fdc4d-a711-4748-9480-bb5a9bab88f4'} Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:47:34.385144 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. Aug 22 05:47:34.386811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:47:34.388139 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-00cd5b31-52ed-4471-86c8-0d1d877641ea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] Returning 404 to user: Instance 585fdc4d-a711-4748-9480-bb5a9bab88f4 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:47:34.388139 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-00cd5b31-52ed-4471-86c8-0d1d877641ea tempest-AttachVolumeTestJSON-1597267240 tempest-AttachVolumeTestJSON-1597267240-project] 10.222.0.18 "GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4" status: 404 len: 111 microversion: 2.1 time: 0.030411 Aug 22 05:47:34.388139 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 416/842] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:34 2022] GET /compute/v2.1/servers/585fdc4d-a711-4748-9480-bb5a9bab88f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:47:34.511229 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-78fddbc1-69d6-4b79-843b-aff3042a44f5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:34.519716 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-78fddbc1-69d6-4b79-843b-aff3042a44f5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:34.521206 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-78fddbc1-69d6-4b79-843b-aff3042a44f5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:34.522667 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-78fddbc1-69d6-4b79-843b-aff3042a44f5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1745 microversion: 2.20 time: 0.171772 Aug 22 05:47:34.523323 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 427/843] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:34 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:35.546895 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a251a0b4-b07d-4842-82a8-072155f51520 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:35.547389 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a251a0b4-b07d-4842-82a8-072155f51520 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:35.555451 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a251a0b4-b07d-4842-82a8-072155f51520 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:35.556213 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a251a0b4-b07d-4842-82a8-072155f51520 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:35.556810 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a251a0b4-b07d-4842-82a8-072155f51520 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:35.558142 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a251a0b4-b07d-4842-82a8-072155f51520 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:35.558759 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a251a0b4-b07d-4842-82a8-072155f51520 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:35.559186 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a251a0b4-b07d-4842-82a8-072155f51520 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:35.767781 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a251a0b4-b07d-4842-82a8-072155f51520 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:35.780721 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a251a0b4-b07d-4842-82a8-072155f51520 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:35.783413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a251a0b4-b07d-4842-82a8-072155f51520 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:35.785415 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a251a0b4-b07d-4842-82a8-072155f51520 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1740 microversion: 2.20 time: 0.243217 Aug 22 05:47:35.787095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 417/844] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:35 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 05:47:36.816352 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5569fc69-b46c-4f52-9837-5071344b0709 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:36.817614 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5569fc69-b46c-4f52-9837-5071344b0709 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:36.831595 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5569fc69-b46c-4f52-9837-5071344b0709 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:36.841522 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5569fc69-b46c-4f52-9837-5071344b0709 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:36.842269 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5569fc69-b46c-4f52-9837-5071344b0709 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:36.843185 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5569fc69-b46c-4f52-9837-5071344b0709 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:36.843815 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5569fc69-b46c-4f52-9837-5071344b0709 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:36.844419 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5569fc69-b46c-4f52-9837-5071344b0709 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:37.067508 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5569fc69-b46c-4f52-9837-5071344b0709 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:37.076582 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5569fc69-b46c-4f52-9837-5071344b0709 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:37.080987 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5569fc69-b46c-4f52-9837-5071344b0709 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:37.085311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5569fc69-b46c-4f52-9837-5071344b0709 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1740 microversion: 2.20 time: 0.278496 Aug 22 05:47:37.089749 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 428/845] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:36 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:38.111050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-43a8214e-ae60-412d-8a67-8281a688a069 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:38.112346 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-43a8214e-ae60-412d-8a67-8281a688a069 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:38.124475 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43a8214e-ae60-412d-8a67-8281a688a069 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:38.125976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43a8214e-ae60-412d-8a67-8281a688a069 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:38.126723 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43a8214e-ae60-412d-8a67-8281a688a069 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:38.128150 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43a8214e-ae60-412d-8a67-8281a688a069 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:38.128761 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43a8214e-ae60-412d-8a67-8281a688a069 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:38.129365 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43a8214e-ae60-412d-8a67-8281a688a069 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:38.314954 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-43a8214e-ae60-412d-8a67-8281a688a069 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:38.321724 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:47:38.334461 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-43a8214e-ae60-412d-8a67-8281a688a069 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:38.340235 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-43a8214e-ae60-412d-8a67-8281a688a069 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:38.342731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-43a8214e-ae60-412d-8a67-8281a688a069 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1740 microversion: 2.20 time: 0.236047 Aug 22 05:47:38.345373 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 418/846] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:38 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:39.368179 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-24debcdb-2092-4f7a-acfb-828a3544ecfd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:39.369585 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-24debcdb-2092-4f7a-acfb-828a3544ecfd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:39.377927 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-24debcdb-2092-4f7a-acfb-828a3544ecfd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:39.378584 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-24debcdb-2092-4f7a-acfb-828a3544ecfd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:39.379402 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-24debcdb-2092-4f7a-acfb-828a3544ecfd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:39.380311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-24debcdb-2092-4f7a-acfb-828a3544ecfd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:39.380959 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-24debcdb-2092-4f7a-acfb-828a3544ecfd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:39.381525 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-24debcdb-2092-4f7a-acfb-828a3544ecfd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:39.541750 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-24debcdb-2092-4f7a-acfb-828a3544ecfd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:39.550611 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-24debcdb-2092-4f7a-acfb-828a3544ecfd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:39.552133 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-24debcdb-2092-4f7a-acfb-828a3544ecfd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:39.553556 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-24debcdb-2092-4f7a-acfb-828a3544ecfd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1740 microversion: 2.20 time: 0.189473 Aug 22 05:47:39.554661 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 429/847] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:39 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:40.583443 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b03b89b1-b0ab-4dcb-991c-38d913057bbb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:40.584905 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b03b89b1-b0ab-4dcb-991c-38d913057bbb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:40.594722 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b03b89b1-b0ab-4dcb-991c-38d913057bbb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:40.607423 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b03b89b1-b0ab-4dcb-991c-38d913057bbb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:40.609096 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b03b89b1-b0ab-4dcb-991c-38d913057bbb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:40.612572 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b03b89b1-b0ab-4dcb-991c-38d913057bbb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:40.615492 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b03b89b1-b0ab-4dcb-991c-38d913057bbb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:40.616191 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b03b89b1-b0ab-4dcb-991c-38d913057bbb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:40.891811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b03b89b1-b0ab-4dcb-991c-38d913057bbb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:40.908228 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b03b89b1-b0ab-4dcb-991c-38d913057bbb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:40.910176 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b03b89b1-b0ab-4dcb-991c-38d913057bbb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:40.914182 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b03b89b1-b0ab-4dcb-991c-38d913057bbb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1740 microversion: 2.20 time: 0.339873 Aug 22 05:47:40.914751 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 419/848] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:40 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1740 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:41.938196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b010a6d4-9595-4ad3-b7f4-6408712f036f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:41.938799 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b010a6d4-9595-4ad3-b7f4-6408712f036f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:41.946159 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b010a6d4-9595-4ad3-b7f4-6408712f036f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:41.946865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b010a6d4-9595-4ad3-b7f4-6408712f036f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:41.947484 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b010a6d4-9595-4ad3-b7f4-6408712f036f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:41.948409 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b010a6d4-9595-4ad3-b7f4-6408712f036f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:41.948859 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b010a6d4-9595-4ad3-b7f4-6408712f036f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:41.949274 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b010a6d4-9595-4ad3-b7f4-6408712f036f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:42.311849 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b010a6d4-9595-4ad3-b7f4-6408712f036f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:42.325638 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b010a6d4-9595-4ad3-b7f4-6408712f036f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:42.327432 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b010a6d4-9595-4ad3-b7f4-6408712f036f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:42.328861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b010a6d4-9595-4ad3-b7f4-6408712f036f tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1740 microversion: 2.20 time: 0.394529 Aug 22 05:47:42.345244 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 430/849] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:41 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1740 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:43.353495 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-344a6b2a-c488-4984-b7a5-613b4bf8da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:43.354077 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-344a6b2a-c488-4984-b7a5-613b4bf8da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:43.365255 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-344a6b2a-c488-4984-b7a5-613b4bf8da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:43.372756 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-344a6b2a-c488-4984-b7a5-613b4bf8da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:43.373450 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-344a6b2a-c488-4984-b7a5-613b4bf8da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:43.376590 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-344a6b2a-c488-4984-b7a5-613b4bf8da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:43.377073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-344a6b2a-c488-4984-b7a5-613b4bf8da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:43.377507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-344a6b2a-c488-4984-b7a5-613b4bf8da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:43.653689 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-344a6b2a-c488-4984-b7a5-613b4bf8da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:43.670713 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-344a6b2a-c488-4984-b7a5-613b4bf8da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:43.673709 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-344a6b2a-c488-4984-b7a5-613b4bf8da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:43.675241 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-344a6b2a-c488-4984-b7a5-613b4bf8da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1740 microversion: 2.20 time: 0.326102 Aug 22 05:47:43.676357 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 420/850] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:43 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1740 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:44.698496 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ef9b5fb8-c21c-4f28-8997-605ad5f2021e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:44.700349 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ef9b5fb8-c21c-4f28-8997-605ad5f2021e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:44.707765 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ef9b5fb8-c21c-4f28-8997-605ad5f2021e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:44.708559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ef9b5fb8-c21c-4f28-8997-605ad5f2021e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:44.709267 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ef9b5fb8-c21c-4f28-8997-605ad5f2021e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:44.710520 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ef9b5fb8-c21c-4f28-8997-605ad5f2021e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:44.711122 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ef9b5fb8-c21c-4f28-8997-605ad5f2021e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:44.711832 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ef9b5fb8-c21c-4f28-8997-605ad5f2021e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:44.938426 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ef9b5fb8-c21c-4f28-8997-605ad5f2021e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:44.960788 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ef9b5fb8-c21c-4f28-8997-605ad5f2021e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:44.967747 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ef9b5fb8-c21c-4f28-8997-605ad5f2021e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:44.969869 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ef9b5fb8-c21c-4f28-8997-605ad5f2021e tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1740 microversion: 2.20 time: 0.275303 Aug 22 05:47:44.971233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 431/851] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:44 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1740 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:45.592613 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0ccbd745-0c4d-4a4a-80f4-549cf0f456ce tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Action: 'create', calling method: .version_select at 0x7f0b3dde75e0>, body: {"keypair": {"name": "tempest-keypair-705822394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+5CugzMG15k8FhgxtebBpEm0oYQ5RmfH9RuYgbP2LaQbc8HMDejeBRISVr2CjfI0jo3CEwejzpP3pEzgwvFzm/bsE0+Y1tjjL7TaHWQEzlGSg2YqaMq0EpAcjhk9RSrg=="}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:47:45.611890 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-0ccbd745-0c4d-4a4a-80f4-549cf0f456ce tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Getting quotas for project fae948b0baa04f2eb07b2aee2785dcdd. Resources: {'key_pairs'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:47:45.617338 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-0ccbd745-0c4d-4a4a-80f4-549cf0f456ce tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Getting quotas for user ed76a574d2fc4bd8a1f1176d0fef86e2 and project fae948b0baa04f2eb07b2aee2785dcdd. Resources: {'key_pairs'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:47:45.650478 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0ccbd745-0c4d-4a4a-80f4-549cf0f456ce tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.244160 Aug 22 05:47:45.651105 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 421/852] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 22 05:47:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:47:45.994624 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-3bc55d04-d53a-4781-ae32-56d8ddb41886 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:45.996946 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-3bc55d04-d53a-4781-ae32-56d8ddb41886 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:46.004264 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3bc55d04-d53a-4781-ae32-56d8ddb41886 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:46.004780 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3bc55d04-d53a-4781-ae32-56d8ddb41886 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:46.005206 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3bc55d04-d53a-4781-ae32-56d8ddb41886 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:46.006141 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3bc55d04-d53a-4781-ae32-56d8ddb41886 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:46.006746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3bc55d04-d53a-4781-ae32-56d8ddb41886 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:46.007323 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3bc55d04-d53a-4781-ae32-56d8ddb41886 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:46.187468 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-3bc55d04-d53a-4781-ae32-56d8ddb41886 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:46.205155 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-3bc55d04-d53a-4781-ae32-56d8ddb41886 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:46.207370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-3bc55d04-d53a-4781-ae32-56d8ddb41886 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:46.209509 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-3bc55d04-d53a-4781-ae32-56d8ddb41886 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1740 microversion: 2.20 time: 0.218877 Aug 22 05:47:46.211050 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 432/853] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:45 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:47.208197 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-634536275", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "01c51a10-ff3b-4b62-bd4e-eb6912d3a3c6"}], "security_groups": [{"name": "tempest-securitygroup--2057886771"}], "key_name": "tempest-keypair-705822394", "user_data": "}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:47:47.236449 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a69cb187-92b1-4fed-8e8f-85db7ba19ac0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:47.237705 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a69cb187-92b1-4fed-8e8f-85db7ba19ac0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:47.244252 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a69cb187-92b1-4fed-8e8f-85db7ba19ac0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:47.244923 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a69cb187-92b1-4fed-8e8f-85db7ba19ac0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:47.245544 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a69cb187-92b1-4fed-8e8f-85db7ba19ac0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:47.246552 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a69cb187-92b1-4fed-8e8f-85db7ba19ac0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:47.247539 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a69cb187-92b1-4fed-8e8f-85db7ba19ac0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:47.248241 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a69cb187-92b1-4fed-8e8f-85db7ba19ac0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:47.348498 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] validate_networks() for [('01c51a10-ff3b-4b62-bd4e-eb6912d3a3c6', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:47:47.477164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a69cb187-92b1-4fed-8e8f-85db7ba19ac0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:47.486255 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a69cb187-92b1-4fed-8e8f-85db7ba19ac0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:47.488028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a69cb187-92b1-4fed-8e8f-85db7ba19ac0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:47.489853 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a69cb187-92b1-4fed-8e8f-85db7ba19ac0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1722 microversion: 2.20 time: 0.257429 Aug 22 05:47:47.506837 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 433/854] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:47 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:47.804154 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:47:47.804581 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:47:47.805051 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:47:47.805771 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:47:47.806184 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:47:47.816694 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:47.817175 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:47.818104 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:47.819200 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:47.819723 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:47.820628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:47.840142 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Getting quotas for project fae948b0baa04f2eb07b2aee2785dcdd. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:47:47.844556 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Getting quotas for user ed76a574d2fc4bd8a1f1176d0fef86e2 and project fae948b0baa04f2eb07b2aee2785dcdd. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:47:47.858985 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:47:47.861353 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:47:47.912850 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-762bd79a-691b-4d5c-9fa8-668f12fe548e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.709773 Aug 22 05:47:47.913828 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 422/855] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:47:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:47:47.924550 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f2c284e4-3916-4dba-b59b-5ce3f7374ed8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:47.925150 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f2c284e4-3916-4dba-b59b-5ce3f7374ed8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:47.986666 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-f2c284e4-3916-4dba-b59b-5ce3f7374ed8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:47.995894 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f2c284e4-3916-4dba-b59b-5ce3f7374ed8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1240 microversion: 2.1 time: 0.075051 Aug 22 05:47:47.996546 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 434/856] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:47 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:47:48.514206 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ff69c16c-0809-4759-ac07-360c12cf4167 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:48.514796 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ff69c16c-0809-4759-ac07-360c12cf4167 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:48.522560 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ff69c16c-0809-4759-ac07-360c12cf4167 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:48.523052 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ff69c16c-0809-4759-ac07-360c12cf4167 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:48.523486 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ff69c16c-0809-4759-ac07-360c12cf4167 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:48.524234 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ff69c16c-0809-4759-ac07-360c12cf4167 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:48.524679 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ff69c16c-0809-4759-ac07-360c12cf4167 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:48.525101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ff69c16c-0809-4759-ac07-360c12cf4167 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:48.659470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ff69c16c-0809-4759-ac07-360c12cf4167 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:48.668816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ff69c16c-0809-4759-ac07-360c12cf4167 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:48.670348 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ff69c16c-0809-4759-ac07-360c12cf4167 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:48.671511 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ff69c16c-0809-4759-ac07-360c12cf4167 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1722 microversion: 2.20 time: 0.161867 Aug 22 05:47:48.672109 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 423/857] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:48 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:49.018039 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e4f1f5d5-f5cb-4115-a9b1-590e78245ffb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:49.018039 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e4f1f5d5-f5cb-4115-a9b1-590e78245ffb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:49.026110 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e4f1f5d5-f5cb-4115-a9b1-590e78245ffb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:49.026599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e4f1f5d5-f5cb-4115-a9b1-590e78245ffb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:49.027020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e4f1f5d5-f5cb-4115-a9b1-590e78245ffb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:49.027763 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e4f1f5d5-f5cb-4115-a9b1-590e78245ffb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:49.028209 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e4f1f5d5-f5cb-4115-a9b1-590e78245ffb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:49.028594 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e4f1f5d5-f5cb-4115-a9b1-590e78245ffb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:49.094234 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e4f1f5d5-f5cb-4115-a9b1-590e78245ffb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:49.102523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e4f1f5d5-f5cb-4115-a9b1-590e78245ffb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1244 microversion: 2.1 time: 0.089252 Aug 22 05:47:49.103379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 435/858] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:49 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:47:49.694828 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fc61cf16-31dd-450c-89b1-164535856f2a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:49.695432 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fc61cf16-31dd-450c-89b1-164535856f2a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:49.702496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc61cf16-31dd-450c-89b1-164535856f2a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:49.702974 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc61cf16-31dd-450c-89b1-164535856f2a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:49.703384 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc61cf16-31dd-450c-89b1-164535856f2a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:49.704187 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc61cf16-31dd-450c-89b1-164535856f2a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:49.704629 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc61cf16-31dd-450c-89b1-164535856f2a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:49.705039 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc61cf16-31dd-450c-89b1-164535856f2a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:49.844583 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fc61cf16-31dd-450c-89b1-164535856f2a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:49.855892 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fc61cf16-31dd-450c-89b1-164535856f2a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:49.857450 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fc61cf16-31dd-450c-89b1-164535856f2a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:49.858770 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fc61cf16-31dd-450c-89b1-164535856f2a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1725 microversion: 2.20 time: 0.168086 Aug 22 05:47:49.859343 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 424/859] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:49 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:49.884634 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-9abf0f90-cc90-4013-b000-b7ac5f2c06c7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61ba7360-5521-4400-8a7c-75652b4550c0"}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:47:49.888703 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-9abf0f90-cc90-4013-b000-b7ac5f2c06c7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:49.898078 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9abf0f90-cc90-4013-b000-b7ac5f2c06c7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:49.899481 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9abf0f90-cc90-4013-b000-b7ac5f2c06c7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:49.900278 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9abf0f90-cc90-4013-b000-b7ac5f2c06c7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:49.901230 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9abf0f90-cc90-4013-b000-b7ac5f2c06c7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:49.901961 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9abf0f90-cc90-4013-b000-b7ac5f2c06c7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:49.903383 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9abf0f90-cc90-4013-b000-b7ac5f2c06c7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:49.950740 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-56e16891-5646-49a5-866f-767707da5238 req-1b43b603-a04f-4ccd-a3f3-45bf0b8455e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64c75c4-9ba2-408f-8bbe-299f7888d6c9", "name": "network-vif-unplugged", "status": "completed", "tag": "3a3f4de9-615b-4419-87d6-e78feae8eeda"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:47:49.968241 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-56e16891-5646-49a5-866f-767707da5238 req-1b43b603-a04f-4ccd-a3f3-45bf0b8455e1 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:49.969776 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-56e16891-5646-49a5-866f-767707da5238 req-1b43b603-a04f-4ccd-a3f3-45bf0b8455e1 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:49.971538 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-56e16891-5646-49a5-866f-767707da5238 req-1b43b603-a04f-4ccd-a3f3-45bf0b8455e1 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:50.004389 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.compute.server_external_events [req-56e16891-5646-49a5-866f-767707da5238 req-1b43b603-a04f-4ccd-a3f3-45bf0b8455e1 service nova] Unable to find a host for instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9. Dropping event network-vif-unplugged {{(pid=132498) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 22 05:47:50.007118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-56e16891-5646-49a5-866f-767707da5238 req-1b43b603-a04f-4ccd-a3f3-45bf0b8455e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.060490 Aug 22 05:47:50.008493 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 425/860] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 62 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 22 05:47:50.122313 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6318470c-12e5-4902-9526-29dd0feee323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:50.123131 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6318470c-12e5-4902-9526-29dd0feee323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:50.133833 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6318470c-12e5-4902-9526-29dd0feee323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:50.135003 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6318470c-12e5-4902-9526-29dd0feee323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:50.137925 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6318470c-12e5-4902-9526-29dd0feee323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:50.138935 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6318470c-12e5-4902-9526-29dd0feee323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:50.139550 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6318470c-12e5-4902-9526-29dd0feee323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:50.140260 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6318470c-12e5-4902-9526-29dd0feee323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:50.228524 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6318470c-12e5-4902-9526-29dd0feee323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:50.237993 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6318470c-12e5-4902-9526-29dd0feee323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1310 microversion: 2.1 time: 0.119556 Aug 22 05:47:50.239656 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 426/861] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:50 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1310 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:47:50.311653 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-9abf0f90-cc90-4013-b000-b7ac5f2c06c7 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "POST /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.431393 Aug 22 05:47:50.318364 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 436/862] 10.222.0.18 () {62 vars in 1364 bytes} [Mon Aug 22 05:47:49 2022] POST /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9/os-volume_attachments => generated 188 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 05:47:50.446413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1bec576c-b697-4ff0-ad18-128769fd2f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:50.446820 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1bec576c-b697-4ff0-ad18-128769fd2f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:50.453138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1bec576c-b697-4ff0-ad18-128769fd2f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:50.453863 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1bec576c-b697-4ff0-ad18-128769fd2f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:50.454306 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1bec576c-b697-4ff0-ad18-128769fd2f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:50.454989 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1bec576c-b697-4ff0-ad18-128769fd2f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:50.455620 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1bec576c-b697-4ff0-ad18-128769fd2f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:50.456037 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1bec576c-b697-4ff0-ad18-128769fd2f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:50.693374 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1bec576c-b697-4ff0-ad18-128769fd2f55 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9/os-volume_attachments/61ba7360-5521-4400-8a7c-75652b4550c0" status: 202 len: 0 microversion: 2.20 time: 0.251272 Aug 22 05:47:50.694044 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 427/863] 10.222.0.18 () {60 vars in 1457 bytes} [Mon Aug 22 05:47:50 2022] DELETE /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9/os-volume_attachments/61ba7360-5521-4400-8a7c-75652b4550c0 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 22 05:47:50.758682 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-54c1a092-6eef-40b3-aea3-57a9e4dd1126 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:47:50.759855 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-54c1a092-6eef-40b3-aea3-57a9e4dd1126 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:50.765939 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-54c1a092-6eef-40b3-aea3-57a9e4dd1126 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:50.766433 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-54c1a092-6eef-40b3-aea3-57a9e4dd1126 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:50.766870 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-54c1a092-6eef-40b3-aea3-57a9e4dd1126 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:50.767589 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-54c1a092-6eef-40b3-aea3-57a9e4dd1126 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:50.768045 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-54c1a092-6eef-40b3-aea3-57a9e4dd1126 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:50.768465 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-54c1a092-6eef-40b3-aea3-57a9e4dd1126 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:50.773344 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:47:50.803070 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-54c1a092-6eef-40b3-aea3-57a9e4dd1126 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132497) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 05:47:50.878237 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-54c1a092-6eef-40b3-aea3-57a9e4dd1126 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "POST /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9/action" status: 202 len: 0 microversion: 2.20 time: 0.123308 Aug 22 05:47:50.879400 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 437/864] 10.222.0.18 () {62 vars in 1319 bytes} [Mon Aug 22 05:47:50 2022] POST /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:47:50.889225 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ccce2178-94a8-4405-aaf3-b66c3ccf9971 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:50.890435 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ccce2178-94a8-4405-aaf3-b66c3ccf9971 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:50.916676 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ccce2178-94a8-4405-aaf3-b66c3ccf9971 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:50.917488 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ccce2178-94a8-4405-aaf3-b66c3ccf9971 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:50.918108 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ccce2178-94a8-4405-aaf3-b66c3ccf9971 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:50.918863 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ccce2178-94a8-4405-aaf3-b66c3ccf9971 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:50.919907 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ccce2178-94a8-4405-aaf3-b66c3ccf9971 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:50.919907 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ccce2178-94a8-4405-aaf3-b66c3ccf9971 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:51.092888 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ccce2178-94a8-4405-aaf3-b66c3ccf9971 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:51.102060 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ccce2178-94a8-4405-aaf3-b66c3ccf9971 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:51.104504 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ccce2178-94a8-4405-aaf3-b66c3ccf9971 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:51.105709 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ccce2178-94a8-4405-aaf3-b66c3ccf9971 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1673 microversion: 2.20 time: 0.221621 Aug 22 05:47:51.106279 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 428/865] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:50 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1673 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:51.262337 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-90bb0881-ec72-498e-bfb8-2a605f9bbefb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:51.262464 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-90bb0881-ec72-498e-bfb8-2a605f9bbefb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:51.269039 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-90bb0881-ec72-498e-bfb8-2a605f9bbefb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:51.269524 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-90bb0881-ec72-498e-bfb8-2a605f9bbefb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:51.269938 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-90bb0881-ec72-498e-bfb8-2a605f9bbefb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:51.270907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-90bb0881-ec72-498e-bfb8-2a605f9bbefb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:51.271517 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-90bb0881-ec72-498e-bfb8-2a605f9bbefb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:51.272097 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-90bb0881-ec72-498e-bfb8-2a605f9bbefb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:51.431484 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-90bb0881-ec72-498e-bfb8-2a605f9bbefb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:51.442100 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-90bb0881-ec72-498e-bfb8-2a605f9bbefb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1366 microversion: 2.1 time: 0.184428 Aug 22 05:47:51.443143 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 438/866] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:51 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:47:51.714151 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-bad6b131-ecdd-443d-ac38-82008274bc7c req-890a3d0a-ded2-45c2-a05b-f8c4cefd8ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8c0835-e37b-42f9-99f6-be6465184333", "tag": "4a9a90ee-356c-40e3-9a4f-7b08c4e6339d"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:47:51.731209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-bad6b131-ecdd-443d-ac38-82008274bc7c req-890a3d0a-ded2-45c2-a05b-f8c4cefd8ce5 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:51.732593 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-bad6b131-ecdd-443d-ac38-82008274bc7c req-890a3d0a-ded2-45c2-a05b-f8c4cefd8ce5 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:51.733308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-bad6b131-ecdd-443d-ac38-82008274bc7c req-890a3d0a-ded2-45c2-a05b-f8c4cefd8ce5 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:51.760556 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-bad6b131-ecdd-443d-ac38-82008274bc7c req-890a3d0a-ded2-45c2-a05b-f8c4cefd8ce5 service nova] Creating event network-changed:4a9a90ee-356c-40e3-9a4f-7b08c4e6339d for instance 3a8c0835-e37b-42f9-99f6-be6465184333 on hv-cinder-85391 Aug 22 05:47:51.776059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-bad6b131-ecdd-443d-ac38-82008274bc7c req-890a3d0a-ded2-45c2-a05b-f8c4cefd8ce5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072475 Aug 22 05:47:51.777516 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 429/867] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:47:52.133849 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-d9c8e977-48a7-40a4-8b64-128ce5ebd055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:52.134877 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-d9c8e977-48a7-40a4-8b64-128ce5ebd055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:52.145121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d9c8e977-48a7-40a4-8b64-128ce5ebd055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:52.146152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d9c8e977-48a7-40a4-8b64-128ce5ebd055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:52.146493 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d9c8e977-48a7-40a4-8b64-128ce5ebd055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:52.147194 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d9c8e977-48a7-40a4-8b64-128ce5ebd055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:52.147654 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d9c8e977-48a7-40a4-8b64-128ce5ebd055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:52.148076 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d9c8e977-48a7-40a4-8b64-128ce5ebd055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:52.348162 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-d9c8e977-48a7-40a4-8b64-128ce5ebd055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:52.356941 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-d9c8e977-48a7-40a4-8b64-128ce5ebd055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:52.358439 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-d9c8e977-48a7-40a4-8b64-128ce5ebd055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:52.359591 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-d9c8e977-48a7-40a4-8b64-128ce5ebd055 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.232566 Aug 22 05:47:52.360163 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 439/868] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:52 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:52.466110 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-eeccc4e4-67d6-4370-90d5-c2b9968b14e7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:52.466813 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-eeccc4e4-67d6-4370-90d5-c2b9968b14e7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:52.473372 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eeccc4e4-67d6-4370-90d5-c2b9968b14e7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:52.473851 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eeccc4e4-67d6-4370-90d5-c2b9968b14e7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:52.474735 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eeccc4e4-67d6-4370-90d5-c2b9968b14e7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:52.475438 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eeccc4e4-67d6-4370-90d5-c2b9968b14e7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:52.476576 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eeccc4e4-67d6-4370-90d5-c2b9968b14e7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:52.477003 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eeccc4e4-67d6-4370-90d5-c2b9968b14e7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:52.624045 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-eeccc4e4-67d6-4370-90d5-c2b9968b14e7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:52.632636 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-eeccc4e4-67d6-4370-90d5-c2b9968b14e7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1366 microversion: 2.1 time: 0.171680 Aug 22 05:47:52.633211 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 430/869] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:52 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:47:53.384798 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-618f7f81-d26f-4b31-9a6c-a3139d684333 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:53.385407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-618f7f81-d26f-4b31-9a6c-a3139d684333 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:53.392548 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-618f7f81-d26f-4b31-9a6c-a3139d684333 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:53.393027 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-618f7f81-d26f-4b31-9a6c-a3139d684333 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:53.393455 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-618f7f81-d26f-4b31-9a6c-a3139d684333 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:53.394147 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-618f7f81-d26f-4b31-9a6c-a3139d684333 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:53.394590 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-618f7f81-d26f-4b31-9a6c-a3139d684333 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:53.395013 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-618f7f81-d26f-4b31-9a6c-a3139d684333 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:53.655394 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9a399f13-1ae8-4c85-a040-87d2f81c109c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:53.656245 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9a399f13-1ae8-4c85-a040-87d2f81c109c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:53.665305 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a399f13-1ae8-4c85-a040-87d2f81c109c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:53.665885 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a399f13-1ae8-4c85-a040-87d2f81c109c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:53.666390 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a399f13-1ae8-4c85-a040-87d2f81c109c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:53.667163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a399f13-1ae8-4c85-a040-87d2f81c109c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:53.667707 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a399f13-1ae8-4c85-a040-87d2f81c109c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:53.668202 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a399f13-1ae8-4c85-a040-87d2f81c109c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:53.702631 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-618f7f81-d26f-4b31-9a6c-a3139d684333 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:53.711020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-618f7f81-d26f-4b31-9a6c-a3139d684333 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:53.712549 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-618f7f81-d26f-4b31-9a6c-a3139d684333 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:53.714109 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-618f7f81-d26f-4b31-9a6c-a3139d684333 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.333538 Aug 22 05:47:53.715002 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 440/870] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:53 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:53.802755 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9a399f13-1ae8-4c85-a040-87d2f81c109c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:53.810967 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9a399f13-1ae8-4c85-a040-87d2f81c109c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1366 microversion: 2.1 time: 0.161410 Aug 22 05:47:53.811599 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 431/871] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:53 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:47:54.736935 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b68f13f1-6b9f-4422-97d1-88ef4a648619 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:54.737541 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b68f13f1-6b9f-4422-97d1-88ef4a648619 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:54.744383 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b68f13f1-6b9f-4422-97d1-88ef4a648619 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:54.744863 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b68f13f1-6b9f-4422-97d1-88ef4a648619 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:54.745316 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b68f13f1-6b9f-4422-97d1-88ef4a648619 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:54.745999 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b68f13f1-6b9f-4422-97d1-88ef4a648619 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:54.746441 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b68f13f1-6b9f-4422-97d1-88ef4a648619 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:54.746855 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b68f13f1-6b9f-4422-97d1-88ef4a648619 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:54.839411 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4e260687-0d3f-4ed1-b10b-045de9599853 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:54.840052 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4e260687-0d3f-4ed1-b10b-045de9599853 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:54.847237 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4e260687-0d3f-4ed1-b10b-045de9599853 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:54.847755 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4e260687-0d3f-4ed1-b10b-045de9599853 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:54.848186 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4e260687-0d3f-4ed1-b10b-045de9599853 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:54.848997 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4e260687-0d3f-4ed1-b10b-045de9599853 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:54.851515 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4e260687-0d3f-4ed1-b10b-045de9599853 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:54.852208 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4e260687-0d3f-4ed1-b10b-045de9599853 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:54.889023 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b68f13f1-6b9f-4422-97d1-88ef4a648619 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:54.905896 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b68f13f1-6b9f-4422-97d1-88ef4a648619 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:54.907614 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b68f13f1-6b9f-4422-97d1-88ef4a648619 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:54.908855 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b68f13f1-6b9f-4422-97d1-88ef4a648619 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.175835 Aug 22 05:47:54.909734 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 441/872] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:54 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:55.299920 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4e260687-0d3f-4ed1-b10b-045de9599853 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:55.310280 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4e260687-0d3f-4ed1-b10b-045de9599853 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1366 microversion: 2.1 time: 0.474915 Aug 22 05:47:55.311473 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 432/873] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:54 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1366 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:47:55.934627 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6d482a04-9d42-4f32-8bb7-98990b645668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:55.935404 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-6d482a04-9d42-4f32-8bb7-98990b645668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:55.946441 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6d482a04-9d42-4f32-8bb7-98990b645668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:55.947200 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6d482a04-9d42-4f32-8bb7-98990b645668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:55.947972 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6d482a04-9d42-4f32-8bb7-98990b645668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:55.948912 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6d482a04-9d42-4f32-8bb7-98990b645668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:55.949527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6d482a04-9d42-4f32-8bb7-98990b645668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:55.950184 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6d482a04-9d42-4f32-8bb7-98990b645668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:56.158270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6d482a04-9d42-4f32-8bb7-98990b645668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:56.168453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6d482a04-9d42-4f32-8bb7-98990b645668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:56.169965 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6d482a04-9d42-4f32-8bb7-98990b645668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:56.172507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6d482a04-9d42-4f32-8bb7-98990b645668 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.243143 Aug 22 05:47:56.173249 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 442/874] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:55 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:56.332201 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fae55680-17d9-4055-8a8c-c6fbc663e5c3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:56.333039 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fae55680-17d9-4055-8a8c-c6fbc663e5c3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:56.340790 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fae55680-17d9-4055-8a8c-c6fbc663e5c3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:56.341281 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fae55680-17d9-4055-8a8c-c6fbc663e5c3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:56.341713 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fae55680-17d9-4055-8a8c-c6fbc663e5c3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:56.342422 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fae55680-17d9-4055-8a8c-c6fbc663e5c3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:56.342893 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fae55680-17d9-4055-8a8c-c6fbc663e5c3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:56.343314 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fae55680-17d9-4055-8a8c-c6fbc663e5c3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:56.499747 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fae55680-17d9-4055-8a8c-c6fbc663e5c3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:56.514867 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fae55680-17d9-4055-8a8c-c6fbc663e5c3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1366 microversion: 2.1 time: 0.186560 Aug 22 05:47:56.516108 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 433/875] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:56 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:47:57.204618 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-20122229-d471-4c63-ac02-82a6dce51104 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:57.205174 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-20122229-d471-4c63-ac02-82a6dce51104 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:57.211907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-20122229-d471-4c63-ac02-82a6dce51104 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:57.212380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-20122229-d471-4c63-ac02-82a6dce51104 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:57.213161 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-20122229-d471-4c63-ac02-82a6dce51104 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:57.213837 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-20122229-d471-4c63-ac02-82a6dce51104 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:57.214273 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-20122229-d471-4c63-ac02-82a6dce51104 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:57.214685 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-20122229-d471-4c63-ac02-82a6dce51104 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:57.352875 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-20122229-d471-4c63-ac02-82a6dce51104 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:57.361238 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-20122229-d471-4c63-ac02-82a6dce51104 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:57.362710 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-20122229-d471-4c63-ac02-82a6dce51104 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:57.363881 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-20122229-d471-4c63-ac02-82a6dce51104 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.163335 Aug 22 05:47:57.364577 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 443/876] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:57 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:57.537075 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-de996361-d779-473f-ae04-f3070e34e683 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:57.537644 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-de996361-d779-473f-ae04-f3070e34e683 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:57.544054 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de996361-d779-473f-ae04-f3070e34e683 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:57.544519 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de996361-d779-473f-ae04-f3070e34e683 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:57.544963 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de996361-d779-473f-ae04-f3070e34e683 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:57.545636 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de996361-d779-473f-ae04-f3070e34e683 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:57.546071 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de996361-d779-473f-ae04-f3070e34e683 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:57.546479 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de996361-d779-473f-ae04-f3070e34e683 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:57.689384 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-de996361-d779-473f-ae04-f3070e34e683 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:57.697607 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-de996361-d779-473f-ae04-f3070e34e683 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1366 microversion: 2.1 time: 0.164721 Aug 22 05:47:57.698198 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 434/877] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:57 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:47:57.993023 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-7136dced-8047-4852-97f0-ee3e20880312 req-f65055b9-de33-4a5d-88d9-0770ecfe4180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8c0835-e37b-42f9-99f6-be6465184333", "name": "network-vif-plugged", "status": "completed", "tag": "4a9a90ee-356c-40e3-9a4f-7b08c4e6339d"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:47:58.007830 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=2 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:47:58.011742 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-7136dced-8047-4852-97f0-ee3e20880312 req-f65055b9-de33-4a5d-88d9-0770ecfe4180 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:58.012213 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-7136dced-8047-4852-97f0-ee3e20880312 req-f65055b9-de33-4a5d-88d9-0770ecfe4180 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:58.012631 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-7136dced-8047-4852-97f0-ee3e20880312 req-f65055b9-de33-4a5d-88d9-0770ecfe4180 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:58.035192 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-7136dced-8047-4852-97f0-ee3e20880312 req-f65055b9-de33-4a5d-88d9-0770ecfe4180 service nova] Creating event network-vif-plugged:4a9a90ee-356c-40e3-9a4f-7b08c4e6339d for instance 3a8c0835-e37b-42f9-99f6-be6465184333 on hv-cinder-85391 Aug 22 05:47:58.045568 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-7136dced-8047-4852-97f0-ee3e20880312 req-f65055b9-de33-4a5d-88d9-0770ecfe4180 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057473 Aug 22 05:47:58.046436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 444/878] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:47:58.387406 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0cde1cc2-e040-4c05-a593-6805c40a5ffb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:58.388037 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0cde1cc2-e040-4c05-a593-6805c40a5ffb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:58.390073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:47:58.391086 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=10 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:47:58.397106 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0cde1cc2-e040-4c05-a593-6805c40a5ffb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:58.397603 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0cde1cc2-e040-4c05-a593-6805c40a5ffb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:58.398068 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0cde1cc2-e040-4c05-a593-6805c40a5ffb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:58.398775 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0cde1cc2-e040-4c05-a593-6805c40a5ffb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:58.399221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0cde1cc2-e040-4c05-a593-6805c40a5ffb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:58.399620 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0cde1cc2-e040-4c05-a593-6805c40a5ffb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:58.541211 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0cde1cc2-e040-4c05-a593-6805c40a5ffb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:58.549751 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0cde1cc2-e040-4c05-a593-6805c40a5ffb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:58.551232 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0cde1cc2-e040-4c05-a593-6805c40a5ffb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:58.552618 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0cde1cc2-e040-4c05-a593-6805c40a5ffb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.169033 Aug 22 05:47:58.553249 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 435/879] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:58 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:58.719794 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e154d623-ca96-416f-8aee-30b2cec73493 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:58.720485 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e154d623-ca96-416f-8aee-30b2cec73493 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:58.727175 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e154d623-ca96-416f-8aee-30b2cec73493 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:58.727704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e154d623-ca96-416f-8aee-30b2cec73493 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:58.728109 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e154d623-ca96-416f-8aee-30b2cec73493 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:58.728781 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e154d623-ca96-416f-8aee-30b2cec73493 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:58.729250 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e154d623-ca96-416f-8aee-30b2cec73493 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:58.729682 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e154d623-ca96-416f-8aee-30b2cec73493 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:58.867139 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e154d623-ca96-416f-8aee-30b2cec73493 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:58.875242 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e154d623-ca96-416f-8aee-30b2cec73493 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1366 microversion: 2.1 time: 0.159638 Aug 22 05:47:58.876093 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 445/880] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:58 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:47:59.577521 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-04609de6-22bc-484d-b4f9-b685a9867d47 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:59.578912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-04609de6-22bc-484d-b4f9-b685a9867d47 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:59.585954 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-04609de6-22bc-484d-b4f9-b685a9867d47 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:59.586894 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-04609de6-22bc-484d-b4f9-b685a9867d47 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:59.587393 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-04609de6-22bc-484d-b4f9-b685a9867d47 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:59.588574 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-04609de6-22bc-484d-b4f9-b685a9867d47 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:59.589083 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-04609de6-22bc-484d-b4f9-b685a9867d47 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:59.589580 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-04609de6-22bc-484d-b4f9-b685a9867d47 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:59.592560 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:47:59.738332 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-04609de6-22bc-484d-b4f9-b685a9867d47 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:59.747680 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-04609de6-22bc-484d-b4f9-b685a9867d47 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:59.749206 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-04609de6-22bc-484d-b4f9-b685a9867d47 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:47:59.750472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-04609de6-22bc-484d-b4f9-b685a9867d47 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.178103 Aug 22 05:47:59.763221 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 436/881] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:47:59 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:47:59.897305 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e37ef60c-157d-4674-91aa-cb3159927ac6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:47:59.899080 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e37ef60c-157d-4674-91aa-cb3159927ac6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:47:59.909313 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e37ef60c-157d-4674-91aa-cb3159927ac6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:59.910246 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e37ef60c-157d-4674-91aa-cb3159927ac6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:59.910714 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e37ef60c-157d-4674-91aa-cb3159927ac6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:47:59.911465 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e37ef60c-157d-4674-91aa-cb3159927ac6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:47:59.911912 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e37ef60c-157d-4674-91aa-cb3159927ac6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:47:59.913451 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e37ef60c-157d-4674-91aa-cb3159927ac6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:00.066166 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e37ef60c-157d-4674-91aa-cb3159927ac6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:00.074704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e37ef60c-157d-4674-91aa-cb3159927ac6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1366 microversion: 2.1 time: 0.181614 Aug 22 05:48:00.075300 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 446/882] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:47:59 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:48:00.776274 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-50d73dc0-b08b-4dca-9a95-2e6b9f501de6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:00.779065 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-50d73dc0-b08b-4dca-9a95-2e6b9f501de6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:00.786189 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:48:00.788754 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-50d73dc0-b08b-4dca-9a95-2e6b9f501de6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:00.790125 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-50d73dc0-b08b-4dca-9a95-2e6b9f501de6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:00.790856 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-50d73dc0-b08b-4dca-9a95-2e6b9f501de6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:00.791643 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-50d73dc0-b08b-4dca-9a95-2e6b9f501de6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:00.792089 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-50d73dc0-b08b-4dca-9a95-2e6b9f501de6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:00.792502 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-50d73dc0-b08b-4dca-9a95-2e6b9f501de6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:00.944069 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-50d73dc0-b08b-4dca-9a95-2e6b9f501de6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:00.952873 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-50d73dc0-b08b-4dca-9a95-2e6b9f501de6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:00.954390 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-50d73dc0-b08b-4dca-9a95-2e6b9f501de6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:00.955568 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-50d73dc0-b08b-4dca-9a95-2e6b9f501de6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.183665 Aug 22 05:48:00.956177 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 437/883] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:48:00 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:48:01.097467 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-55f95af7-a86e-425f-ae89-caf5094bb395 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:01.099011 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-55f95af7-a86e-425f-ae89-caf5094bb395 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:01.105860 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:48:01.107700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-55f95af7-a86e-425f-ae89-caf5094bb395 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:01.108438 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-55f95af7-a86e-425f-ae89-caf5094bb395 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:01.109126 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-55f95af7-a86e-425f-ae89-caf5094bb395 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:01.110056 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-55f95af7-a86e-425f-ae89-caf5094bb395 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:01.110721 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-55f95af7-a86e-425f-ae89-caf5094bb395 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:01.111366 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-55f95af7-a86e-425f-ae89-caf5094bb395 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:01.251183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-55f95af7-a86e-425f-ae89-caf5094bb395 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:01.259445 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-55f95af7-a86e-425f-ae89-caf5094bb395 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1366 microversion: 2.1 time: 0.166836 Aug 22 05:48:01.260076 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 447/884] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:48:01 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:48:01.980800 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9c48e2ab-56b4-4357-98cb-7678039ff2ce tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:01.981402 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9c48e2ab-56b4-4357-98cb-7678039ff2ce tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:01.988199 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c48e2ab-56b4-4357-98cb-7678039ff2ce tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:01.988680 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c48e2ab-56b4-4357-98cb-7678039ff2ce tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:01.989113 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c48e2ab-56b4-4357-98cb-7678039ff2ce tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:01.990969 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c48e2ab-56b4-4357-98cb-7678039ff2ce tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:01.991428 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c48e2ab-56b4-4357-98cb-7678039ff2ce tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:01.991882 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c48e2ab-56b4-4357-98cb-7678039ff2ce tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:02.137122 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9c48e2ab-56b4-4357-98cb-7678039ff2ce tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:02.145680 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9c48e2ab-56b4-4357-98cb-7678039ff2ce tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:02.147285 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9c48e2ab-56b4-4357-98cb-7678039ff2ce tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:02.148467 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9c48e2ab-56b4-4357-98cb-7678039ff2ce tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.171639 Aug 22 05:48:02.149298 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 438/885] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:48:01 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 05:48:02.282373 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-59a12964-bc3c-483f-95d9-4dd9d8d88d95 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:02.283052 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-59a12964-bc3c-483f-95d9-4dd9d8d88d95 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:02.289414 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-59a12964-bc3c-483f-95d9-4dd9d8d88d95 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:02.289892 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-59a12964-bc3c-483f-95d9-4dd9d8d88d95 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:02.290324 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-59a12964-bc3c-483f-95d9-4dd9d8d88d95 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:02.291016 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-59a12964-bc3c-483f-95d9-4dd9d8d88d95 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:02.291496 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-59a12964-bc3c-483f-95d9-4dd9d8d88d95 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:02.291942 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-59a12964-bc3c-483f-95d9-4dd9d8d88d95 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:02.434976 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-59a12964-bc3c-483f-95d9-4dd9d8d88d95 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:02.442860 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-59a12964-bc3c-483f-95d9-4dd9d8d88d95 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1366 microversion: 2.1 time: 0.164342 Aug 22 05:48:02.443385 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 448/886] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:48:02 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:48:03.171639 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5bd8d5ec-e078-4cfd-ad7c-eba34631419b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:03.172278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5bd8d5ec-e078-4cfd-ad7c-eba34631419b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:03.179285 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5bd8d5ec-e078-4cfd-ad7c-eba34631419b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:03.179783 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5bd8d5ec-e078-4cfd-ad7c-eba34631419b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:03.180257 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5bd8d5ec-e078-4cfd-ad7c-eba34631419b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:03.180878 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5bd8d5ec-e078-4cfd-ad7c-eba34631419b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:03.181317 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5bd8d5ec-e078-4cfd-ad7c-eba34631419b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:03.181730 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5bd8d5ec-e078-4cfd-ad7c-eba34631419b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:03.315858 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5bd8d5ec-e078-4cfd-ad7c-eba34631419b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:03.325909 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5bd8d5ec-e078-4cfd-ad7c-eba34631419b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:03.327565 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5bd8d5ec-e078-4cfd-ad7c-eba34631419b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:03.328974 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5bd8d5ec-e078-4cfd-ad7c-eba34631419b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.161282 Aug 22 05:48:03.329705 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 439/887] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:48:03 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:48:03.465210 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c550fc3e-3378-416f-9057-09b3d85b0def tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:03.465778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c550fc3e-3378-416f-9057-09b3d85b0def tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:03.472621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c550fc3e-3378-416f-9057-09b3d85b0def tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:03.473099 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c550fc3e-3378-416f-9057-09b3d85b0def tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:03.473532 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c550fc3e-3378-416f-9057-09b3d85b0def tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:03.474366 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c550fc3e-3378-416f-9057-09b3d85b0def tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:03.474810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c550fc3e-3378-416f-9057-09b3d85b0def tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:03.475242 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c550fc3e-3378-416f-9057-09b3d85b0def tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:03.613446 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c550fc3e-3378-416f-9057-09b3d85b0def tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:03.622421 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c550fc3e-3378-416f-9057-09b3d85b0def tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1366 microversion: 2.1 time: 0.161550 Aug 22 05:48:03.622999 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 449/888] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:48:03 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:48:04.355542 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5570fded-b08f-430d-b850-cd689bcd2af3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:04.356172 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5570fded-b08f-430d-b850-cd689bcd2af3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:04.363129 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5570fded-b08f-430d-b850-cd689bcd2af3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:04.363642 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5570fded-b08f-430d-b850-cd689bcd2af3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:04.364105 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5570fded-b08f-430d-b850-cd689bcd2af3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:04.364798 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5570fded-b08f-430d-b850-cd689bcd2af3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:04.365249 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5570fded-b08f-430d-b850-cd689bcd2af3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:04.365673 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5570fded-b08f-430d-b850-cd689bcd2af3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:04.506779 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5570fded-b08f-430d-b850-cd689bcd2af3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:04.515611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5570fded-b08f-430d-b850-cd689bcd2af3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:04.517150 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5570fded-b08f-430d-b850-cd689bcd2af3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:04.518306 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5570fded-b08f-430d-b850-cd689bcd2af3 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.166896 Aug 22 05:48:04.518881 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 440/889] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:48:04 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:48:04.646528 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-9d46607c-025c-467a-9951-cc3dd611d425 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:04.647888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-9d46607c-025c-467a-9951-cc3dd611d425 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:04.655067 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9d46607c-025c-467a-9951-cc3dd611d425 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:04.655547 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9d46607c-025c-467a-9951-cc3dd611d425 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:04.656005 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9d46607c-025c-467a-9951-cc3dd611d425 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:04.656688 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9d46607c-025c-467a-9951-cc3dd611d425 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:04.657135 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9d46607c-025c-467a-9951-cc3dd611d425 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:04.657548 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9d46607c-025c-467a-9951-cc3dd611d425 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:04.804171 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-9d46607c-025c-467a-9951-cc3dd611d425 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:04.812397 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-9d46607c-025c-467a-9951-cc3dd611d425 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1366 microversion: 2.1 time: 0.172458 Aug 22 05:48:04.812964 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 450/890] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:48:04 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:48:05.545806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2785e6e2-dc25-4189-9782-2816682828cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:05.546674 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2785e6e2-dc25-4189-9782-2816682828cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:05.557636 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2785e6e2-dc25-4189-9782-2816682828cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:05.558428 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2785e6e2-dc25-4189-9782-2816682828cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:05.559139 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2785e6e2-dc25-4189-9782-2816682828cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:05.560332 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2785e6e2-dc25-4189-9782-2816682828cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:05.561031 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2785e6e2-dc25-4189-9782-2816682828cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:05.561715 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2785e6e2-dc25-4189-9782-2816682828cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:05.707168 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2785e6e2-dc25-4189-9782-2816682828cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:05.716419 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2785e6e2-dc25-4189-9782-2816682828cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:05.717895 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2785e6e2-dc25-4189-9782-2816682828cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:05.719058 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2785e6e2-dc25-4189-9782-2816682828cf tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.179945 Aug 22 05:48:05.719619 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 441/891] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:48:05 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:48:05.836604 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-26fcfe5a-94f5-4f16-87ff-70412a620cb6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:05.837164 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-26fcfe5a-94f5-4f16-87ff-70412a620cb6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:05.844191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26fcfe5a-94f5-4f16-87ff-70412a620cb6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:05.844652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26fcfe5a-94f5-4f16-87ff-70412a620cb6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:05.845083 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26fcfe5a-94f5-4f16-87ff-70412a620cb6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:05.845767 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26fcfe5a-94f5-4f16-87ff-70412a620cb6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:05.846214 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26fcfe5a-94f5-4f16-87ff-70412a620cb6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:05.846628 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26fcfe5a-94f5-4f16-87ff-70412a620cb6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:05.984772 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-26fcfe5a-94f5-4f16-87ff-70412a620cb6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:05.994910 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-26fcfe5a-94f5-4f16-87ff-70412a620cb6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1366 microversion: 2.1 time: 0.164288 Aug 22 05:48:05.995473 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 451/892] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:48:05 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:48:06.745646 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0c75da25-5d66-40b6-b667-4540b1beb2bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:06.746407 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0c75da25-5d66-40b6-b667-4540b1beb2bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:06.754778 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0c75da25-5d66-40b6-b667-4540b1beb2bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:06.755371 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0c75da25-5d66-40b6-b667-4540b1beb2bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:06.755950 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0c75da25-5d66-40b6-b667-4540b1beb2bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:06.757090 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0c75da25-5d66-40b6-b667-4540b1beb2bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:06.757328 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0c75da25-5d66-40b6-b667-4540b1beb2bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:06.757741 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0c75da25-5d66-40b6-b667-4540b1beb2bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:06.892298 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0c75da25-5d66-40b6-b667-4540b1beb2bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:06.901154 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0c75da25-5d66-40b6-b667-4540b1beb2bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:06.902512 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0c75da25-5d66-40b6-b667-4540b1beb2bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:06.903732 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0c75da25-5d66-40b6-b667-4540b1beb2bb tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.163770 Aug 22 05:48:06.904286 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 442/893] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:48:06 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:48:07.020420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-40edd627-fd7d-4973-9976-3d2676af9eb8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:07.021003 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-40edd627-fd7d-4973-9976-3d2676af9eb8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:07.031637 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-40edd627-fd7d-4973-9976-3d2676af9eb8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:07.032327 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-40edd627-fd7d-4973-9976-3d2676af9eb8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:07.032955 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-40edd627-fd7d-4973-9976-3d2676af9eb8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:07.034006 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-40edd627-fd7d-4973-9976-3d2676af9eb8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:07.034669 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-40edd627-fd7d-4973-9976-3d2676af9eb8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:07.035301 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-40edd627-fd7d-4973-9976-3d2676af9eb8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:07.176858 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-40edd627-fd7d-4973-9976-3d2676af9eb8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:07.185322 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-40edd627-fd7d-4973-9976-3d2676af9eb8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1366 microversion: 2.1 time: 0.171735 Aug 22 05:48:07.185891 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 452/894] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:48:07 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:48:07.931471 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-84a44129-6d7a-4f9c-848d-b2de0b9d8842 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:07.932052 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-84a44129-6d7a-4f9c-848d-b2de0b9d8842 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:07.938919 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84a44129-6d7a-4f9c-848d-b2de0b9d8842 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:07.939401 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84a44129-6d7a-4f9c-848d-b2de0b9d8842 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:07.939912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84a44129-6d7a-4f9c-848d-b2de0b9d8842 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:07.940596 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84a44129-6d7a-4f9c-848d-b2de0b9d8842 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:07.941223 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84a44129-6d7a-4f9c-848d-b2de0b9d8842 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:07.941863 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84a44129-6d7a-4f9c-848d-b2de0b9d8842 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:08.132940 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-84a44129-6d7a-4f9c-848d-b2de0b9d8842 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:08.141882 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-84a44129-6d7a-4f9c-848d-b2de0b9d8842 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:08.143381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-84a44129-6d7a-4f9c-848d-b2de0b9d8842 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:08.144573 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-84a44129-6d7a-4f9c-848d-b2de0b9d8842 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.218422 Aug 22 05:48:08.145153 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 443/895] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:48:07 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:48:08.209525 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-2f7ebd39-26f9-46f3-9b48-a9da383f34d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:08.210414 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-2f7ebd39-26f9-46f3-9b48-a9da383f34d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:08.219290 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f7ebd39-26f9-46f3-9b48-a9da383f34d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:08.220024 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f7ebd39-26f9-46f3-9b48-a9da383f34d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:08.220674 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f7ebd39-26f9-46f3-9b48-a9da383f34d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:08.221759 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f7ebd39-26f9-46f3-9b48-a9da383f34d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:08.222494 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f7ebd39-26f9-46f3-9b48-a9da383f34d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:08.223127 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f7ebd39-26f9-46f3-9b48-a9da383f34d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:08.243991 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:48:08.362095 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-2f7ebd39-26f9-46f3-9b48-a9da383f34d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:08.369832 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-2f7ebd39-26f9-46f3-9b48-a9da383f34d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1366 microversion: 2.1 time: 0.166554 Aug 22 05:48:08.370388 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 453/896] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:48:08 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:48:09.173371 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1d8eb5ba-a887-4800-b522-ae8cd865da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:09.174304 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1d8eb5ba-a887-4800-b522-ae8cd865da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:09.183637 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d8eb5ba-a887-4800-b522-ae8cd865da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:09.184159 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d8eb5ba-a887-4800-b522-ae8cd865da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:09.184575 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d8eb5ba-a887-4800-b522-ae8cd865da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:09.185259 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d8eb5ba-a887-4800-b522-ae8cd865da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:09.185697 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d8eb5ba-a887-4800-b522-ae8cd865da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:09.186118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d8eb5ba-a887-4800-b522-ae8cd865da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:09.328749 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1d8eb5ba-a887-4800-b522-ae8cd865da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:09.339682 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1d8eb5ba-a887-4800-b522-ae8cd865da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:09.341219 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1d8eb5ba-a887-4800-b522-ae8cd865da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:09.342377 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1d8eb5ba-a887-4800-b522-ae8cd865da69 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.175745 Aug 22 05:48:09.342973 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 444/897] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:48:09 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:48:09.394504 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b5106836-e001-489d-9b80-0b12d35dcb27 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:09.395494 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b5106836-e001-489d-9b80-0b12d35dcb27 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:09.406936 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b5106836-e001-489d-9b80-0b12d35dcb27 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:09.407777 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b5106836-e001-489d-9b80-0b12d35dcb27 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:09.408495 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b5106836-e001-489d-9b80-0b12d35dcb27 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:09.409632 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b5106836-e001-489d-9b80-0b12d35dcb27 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:09.410384 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b5106836-e001-489d-9b80-0b12d35dcb27 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:09.411080 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b5106836-e001-489d-9b80-0b12d35dcb27 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:09.552762 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b5106836-e001-489d-9b80-0b12d35dcb27 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:09.561075 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b5106836-e001-489d-9b80-0b12d35dcb27 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1366 microversion: 2.1 time: 0.172889 Aug 22 05:48:09.561615 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 454/898] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:48:09 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:48:10.369538 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-03e965dd-1cb2-4545-bd3c-69d8570d3f5a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:10.370548 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-03e965dd-1cb2-4545-bd3c-69d8570d3f5a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:10.381972 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03e965dd-1cb2-4545-bd3c-69d8570d3f5a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:10.382425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03e965dd-1cb2-4545-bd3c-69d8570d3f5a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:10.382862 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03e965dd-1cb2-4545-bd3c-69d8570d3f5a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:10.383544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03e965dd-1cb2-4545-bd3c-69d8570d3f5a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:10.384035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03e965dd-1cb2-4545-bd3c-69d8570d3f5a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:10.384430 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03e965dd-1cb2-4545-bd3c-69d8570d3f5a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:10.516623 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-03e965dd-1cb2-4545-bd3c-69d8570d3f5a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:10.525287 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-03e965dd-1cb2-4545-bd3c-69d8570d3f5a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:10.526793 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-03e965dd-1cb2-4545-bd3c-69d8570d3f5a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:10.527966 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-03e965dd-1cb2-4545-bd3c-69d8570d3f5a tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.165064 Aug 22 05:48:10.528731 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 445/899] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:48:10 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:48:10.583019 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-cc160f8a-9476-4e5f-ae72-1a12f15762c8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:10.583605 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-cc160f8a-9476-4e5f-ae72-1a12f15762c8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:10.590947 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cc160f8a-9476-4e5f-ae72-1a12f15762c8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:10.591460 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cc160f8a-9476-4e5f-ae72-1a12f15762c8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:10.591927 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cc160f8a-9476-4e5f-ae72-1a12f15762c8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:10.592607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cc160f8a-9476-4e5f-ae72-1a12f15762c8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:10.593051 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cc160f8a-9476-4e5f-ae72-1a12f15762c8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:10.593466 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cc160f8a-9476-4e5f-ae72-1a12f15762c8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:10.733426 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-cc160f8a-9476-4e5f-ae72-1a12f15762c8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:10.741761 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-cc160f8a-9476-4e5f-ae72-1a12f15762c8 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1556 microversion: 2.1 time: 0.162742 Aug 22 05:48:10.742321 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 455/900] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:48:10 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:48:10.761922 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fa0d68ca-8e78-4b7a-888d-4b730ca084d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:10.762403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fa0d68ca-8e78-4b7a-888d-4b730ca084d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:10.768744 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fa0d68ca-8e78-4b7a-888d-4b730ca084d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:10.769232 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fa0d68ca-8e78-4b7a-888d-4b730ca084d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:10.769662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fa0d68ca-8e78-4b7a-888d-4b730ca084d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:10.770336 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fa0d68ca-8e78-4b7a-888d-4b730ca084d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:10.770778 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fa0d68ca-8e78-4b7a-888d-4b730ca084d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:10.771190 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fa0d68ca-8e78-4b7a-888d-4b730ca084d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:10.863107 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fa0d68ca-8e78-4b7a-888d-4b730ca084d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104643 Aug 22 05:48:10.864053 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 446/901] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Aug 22 05:48:10 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:48:11.550700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0d360ef8-6683-4edb-8bf1-a50d2527a0b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:11.551290 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0d360ef8-6683-4edb-8bf1-a50d2527a0b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:11.558488 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0d360ef8-6683-4edb-8bf1-a50d2527a0b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:11.558974 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0d360ef8-6683-4edb-8bf1-a50d2527a0b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:11.559401 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0d360ef8-6683-4edb-8bf1-a50d2527a0b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:11.560122 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0d360ef8-6683-4edb-8bf1-a50d2527a0b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:11.560574 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0d360ef8-6683-4edb-8bf1-a50d2527a0b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:11.560996 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0d360ef8-6683-4edb-8bf1-a50d2527a0b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:11.758718 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0d360ef8-6683-4edb-8bf1-a50d2527a0b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:11.768112 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0d360ef8-6683-4edb-8bf1-a50d2527a0b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:11.769597 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0d360ef8-6683-4edb-8bf1-a50d2527a0b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:11.770753 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0d360ef8-6683-4edb-8bf1-a50d2527a0b6 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.224169 Aug 22 05:48:11.771323 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 456/902] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:48:11 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:48:11.907873 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-6456bc76-cfe1-4482-afb8-b7a62b96b6e1 req-87035db4-2db3-4aaf-bbf4-4fae49eb2e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8c0835-e37b-42f9-99f6-be6465184333", "tag": "4a9a90ee-356c-40e3-9a4f-7b08c4e6339d"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:48:11.917539 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-6456bc76-cfe1-4482-afb8-b7a62b96b6e1 req-87035db4-2db3-4aaf-bbf4-4fae49eb2e77 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:11.918001 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-6456bc76-cfe1-4482-afb8-b7a62b96b6e1 req-87035db4-2db3-4aaf-bbf4-4fae49eb2e77 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:11.918442 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-6456bc76-cfe1-4482-afb8-b7a62b96b6e1 req-87035db4-2db3-4aaf-bbf4-4fae49eb2e77 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:11.932438 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-6456bc76-cfe1-4482-afb8-b7a62b96b6e1 req-87035db4-2db3-4aaf-bbf4-4fae49eb2e77 service nova] Creating event network-changed:4a9a90ee-356c-40e3-9a4f-7b08c4e6339d for instance 3a8c0835-e37b-42f9-99f6-be6465184333 on hv-cinder-85391 Aug 22 05:48:11.937903 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-6456bc76-cfe1-4482-afb8-b7a62b96b6e1 req-87035db4-2db3-4aaf-bbf4-4fae49eb2e77 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034443 Aug 22 05:48:11.938508 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 447/903] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:48:12.007952 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-77fbf9bb-0900-44e2-a83d-f41d79c39004 req-38997e7b-a5c9-4764-b4be-47b52353c829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64c75c4-9ba2-408f-8bbe-299f7888d6c9", "name": "network-vif-plugged", "status": "completed", "tag": "3a3f4de9-615b-4419-87d6-e78feae8eeda"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:48:12.017556 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-77fbf9bb-0900-44e2-a83d-f41d79c39004 req-38997e7b-a5c9-4764-b4be-47b52353c829 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:12.017971 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-77fbf9bb-0900-44e2-a83d-f41d79c39004 req-38997e7b-a5c9-4764-b4be-47b52353c829 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:12.018587 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-77fbf9bb-0900-44e2-a83d-f41d79c39004 req-38997e7b-a5c9-4764-b4be-47b52353c829 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:12.035131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-77fbf9bb-0900-44e2-a83d-f41d79c39004 req-38997e7b-a5c9-4764-b4be-47b52353c829 service nova] Creating event network-vif-plugged:3a3f4de9-615b-4419-87d6-e78feae8eeda for instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 on hv-cinder-85391 Aug 22 05:48:12.041421 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-77fbf9bb-0900-44e2-a83d-f41d79c39004 req-38997e7b-a5c9-4764-b4be-47b52353c829 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037699 Aug 22 05:48:12.043066 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 457/904] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:48:12.795202 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4fd06f00-86ac-4cec-ab54-4078223459b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:12.795937 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4fd06f00-86ac-4cec-ab54-4078223459b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:12.802698 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4fd06f00-86ac-4cec-ab54-4078223459b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:12.803176 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4fd06f00-86ac-4cec-ab54-4078223459b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:12.803675 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4fd06f00-86ac-4cec-ab54-4078223459b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:12.804411 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4fd06f00-86ac-4cec-ab54-4078223459b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:12.804859 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4fd06f00-86ac-4cec-ab54-4078223459b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:12.805276 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4fd06f00-86ac-4cec-ab54-4078223459b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:13.015347 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4fd06f00-86ac-4cec-ab54-4078223459b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:13.024291 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4fd06f00-86ac-4cec-ab54-4078223459b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:13.025943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4fd06f00-86ac-4cec-ab54-4078223459b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:13.027065 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4fd06f00-86ac-4cec-ab54-4078223459b0 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.236277 Aug 22 05:48:13.027699 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 448/905] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:48:12 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:48:14.052622 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ed194e98-6d96-40bd-b036-0bb4b5b26bbd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:14.053202 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ed194e98-6d96-40bd-b036-0bb4b5b26bbd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:14.064023 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed194e98-6d96-40bd-b036-0bb4b5b26bbd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:14.064814 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed194e98-6d96-40bd-b036-0bb4b5b26bbd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:14.065524 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed194e98-6d96-40bd-b036-0bb4b5b26bbd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:14.066662 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed194e98-6d96-40bd-b036-0bb4b5b26bbd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:14.067423 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed194e98-6d96-40bd-b036-0bb4b5b26bbd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:14.068178 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed194e98-6d96-40bd-b036-0bb4b5b26bbd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:14.266163 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ed194e98-6d96-40bd-b036-0bb4b5b26bbd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:14.275010 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ed194e98-6d96-40bd-b036-0bb4b5b26bbd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:14.276528 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ed194e98-6d96-40bd-b036-0bb4b5b26bbd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:14.277689 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ed194e98-6d96-40bd-b036-0bb4b5b26bbd tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1731 microversion: 2.20 time: 0.230753 Aug 22 05:48:14.278468 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 458/906] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:48:14 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1731 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:48:15.305035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-02e58750-55e1-4170-b94c-98774546597b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:48:15.305640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-02e58750-55e1-4170-b94c-98774546597b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:48:15.313402 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-02e58750-55e1-4170-b94c-98774546597b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:15.313928 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-02e58750-55e1-4170-b94c-98774546597b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:15.314405 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-02e58750-55e1-4170-b94c-98774546597b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:15.315154 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-02e58750-55e1-4170-b94c-98774546597b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:48:15.315674 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-02e58750-55e1-4170-b94c-98774546597b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:48:15.316135 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-02e58750-55e1-4170-b94c-98774546597b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:48:15.460877 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-02e58750-55e1-4170-b94c-98774546597b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:15.469747 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-02e58750-55e1-4170-b94c-98774546597b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:15.471227 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-02e58750-55e1-4170-b94c-98774546597b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:48:15.472410 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-02e58750-55e1-4170-b94c-98774546597b tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1718 microversion: 2.20 time: 0.174001 Aug 22 05:48:15.472974 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 449/907] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:48:15 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1718 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:49:11.165085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f8afbbf5-705c-4320-af74-e6a9e05277b8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:11.167211 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f8afbbf5-705c-4320-af74-e6a9e05277b8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:11.169505 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=23 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:49:11.170176 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=28 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:49:11.176403 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f8afbbf5-705c-4320-af74-e6a9e05277b8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:11.176886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f8afbbf5-705c-4320-af74-e6a9e05277b8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:11.177304 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f8afbbf5-705c-4320-af74-e6a9e05277b8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:11.178001 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f8afbbf5-705c-4320-af74-e6a9e05277b8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:11.178453 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f8afbbf5-705c-4320-af74-e6a9e05277b8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:11.178872 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f8afbbf5-705c-4320-af74-e6a9e05277b8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:11.209341 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f8afbbf5-705c-4320-af74-e6a9e05277b8 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050354 Aug 22 05:49:11.209897 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 459/908] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Aug 22 05:49:11 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:49:11.273768 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fc5c22b2-6d61-4a16-9f4d-76f54b1bca6c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:11.274343 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fc5c22b2-6d61-4a16-9f4d-76f54b1bca6c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:11.276578 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=25 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:49:11.277234 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=77 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:49:11.283467 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc5c22b2-6d61-4a16-9f4d-76f54b1bca6c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:11.283973 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc5c22b2-6d61-4a16-9f4d-76f54b1bca6c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:11.284418 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc5c22b2-6d61-4a16-9f4d-76f54b1bca6c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:11.285110 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc5c22b2-6d61-4a16-9f4d-76f54b1bca6c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:11.285559 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc5c22b2-6d61-4a16-9f4d-76f54b1bca6c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:11.285979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc5c22b2-6d61-4a16-9f4d-76f54b1bca6c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:11.311865 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fc5c22b2-6d61-4a16-9f4d-76f54b1bca6c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:49:11.391753 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fc5c22b2-6d61-4a16-9f4d-76f54b1bca6c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 204 len: 0 microversion: 2.20 time: 0.121797 Aug 22 05:49:11.392512 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 450/909] 10.222.0.18 () {60 vars in 1280 bytes} [Mon Aug 22 05:49:11 2022] DELETE /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 05:49:11.401072 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c9acb487-4197-4b79-9aac-4b9dfd408fc4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:11.401686 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c9acb487-4197-4b79-9aac-4b9dfd408fc4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:11.408064 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c9acb487-4197-4b79-9aac-4b9dfd408fc4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:11.408546 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c9acb487-4197-4b79-9aac-4b9dfd408fc4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:11.408978 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c9acb487-4197-4b79-9aac-4b9dfd408fc4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:11.409668 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c9acb487-4197-4b79-9aac-4b9dfd408fc4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:11.410117 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c9acb487-4197-4b79-9aac-4b9dfd408fc4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:11.410539 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c9acb487-4197-4b79-9aac-4b9dfd408fc4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:11.557109 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c9acb487-4197-4b79-9aac-4b9dfd408fc4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:11.566625 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c9acb487-4197-4b79-9aac-4b9dfd408fc4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:11.568172 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c9acb487-4197-4b79-9aac-4b9dfd408fc4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:11.569338 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c9acb487-4197-4b79-9aac-4b9dfd408fc4 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1724 microversion: 2.20 time: 0.172483 Aug 22 05:49:11.571620 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 460/910] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:49:11 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:49:12.597935 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f5d78891-f542-48fd-b0bf-3eb378c4651c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:12.599037 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f5d78891-f542-48fd-b0bf-3eb378c4651c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:12.606535 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5d78891-f542-48fd-b0bf-3eb378c4651c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:12.607021 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5d78891-f542-48fd-b0bf-3eb378c4651c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:12.607464 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5d78891-f542-48fd-b0bf-3eb378c4651c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:12.608174 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5d78891-f542-48fd-b0bf-3eb378c4651c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:12.608620 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5d78891-f542-48fd-b0bf-3eb378c4651c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:12.609038 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5d78891-f542-48fd-b0bf-3eb378c4651c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:12.748996 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f5d78891-f542-48fd-b0bf-3eb378c4651c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:12.758328 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f5d78891-f542-48fd-b0bf-3eb378c4651c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:12.759373 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f5d78891-f542-48fd-b0bf-3eb378c4651c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:12.760574 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f5d78891-f542-48fd-b0bf-3eb378c4651c tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1724 microversion: 2.20 time: 0.170185 Aug 22 05:49:12.761131 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 451/911] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:49:12 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:49:13.784304 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c525afdc-f438-43d2-8ed8-b7d29292d011 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:13.784912 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c525afdc-f438-43d2-8ed8-b7d29292d011 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:13.792214 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c525afdc-f438-43d2-8ed8-b7d29292d011 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:13.792691 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c525afdc-f438-43d2-8ed8-b7d29292d011 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:13.793119 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c525afdc-f438-43d2-8ed8-b7d29292d011 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:13.793805 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c525afdc-f438-43d2-8ed8-b7d29292d011 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:13.794249 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c525afdc-f438-43d2-8ed8-b7d29292d011 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:13.794662 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c525afdc-f438-43d2-8ed8-b7d29292d011 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:13.860338 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c525afdc-f438-43d2-8ed8-b7d29292d011 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:13.869752 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c525afdc-f438-43d2-8ed8-b7d29292d011 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:13.871619 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c525afdc-f438-43d2-8ed8-b7d29292d011 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2864050fd1a64646a8760f0172be8f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e3216211942959311372c2d078202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:13.872851 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c525afdc-f438-43d2-8ed8-b7d29292d011 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 200 len: 1657 microversion: 2.20 time: 0.092494 Aug 22 05:49:13.887602 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 461/912] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:49:13 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 1657 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 05:49:13.918359 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-a19de460-c3f0-4322-b7ca-97e7e9b42195 req-b3247ed1-3099-40ba-a0bb-52692d51f203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64c75c4-9ba2-408f-8bbe-299f7888d6c9", "name": "network-vif-deleted", "tag": "3a3f4de9-615b-4419-87d6-e78feae8eeda"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:49:13.932307 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-a19de460-c3f0-4322-b7ca-97e7e9b42195 req-b3247ed1-3099-40ba-a0bb-52692d51f203 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:13.933086 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-a19de460-c3f0-4322-b7ca-97e7e9b42195 req-b3247ed1-3099-40ba-a0bb-52692d51f203 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:13.933670 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-a19de460-c3f0-4322-b7ca-97e7e9b42195 req-b3247ed1-3099-40ba-a0bb-52692d51f203 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:13.946036 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-a19de460-c3f0-4322-b7ca-97e7e9b42195 req-b3247ed1-3099-40ba-a0bb-52692d51f203 service nova] Creating event network-vif-deleted:3a3f4de9-615b-4419-87d6-e78feae8eeda for instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 on hv-cinder-85391 Aug 22 05:49:13.952728 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-a19de460-c3f0-4322-b7ca-97e7e9b42195 req-b3247ed1-3099-40ba-a0bb-52692d51f203 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037898 Aug 22 05:49:13.953864 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 452/913] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:49:14.898663 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0a36bde4-e796-43e2-bb9a-468518b985a5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:14.899267 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0a36bde4-e796-43e2-bb9a-468518b985a5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:14.905888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a36bde4-e796-43e2-bb9a-468518b985a5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:14.906366 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a36bde4-e796-43e2-bb9a-468518b985a5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:14.906818 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a36bde4-e796-43e2-bb9a-468518b985a5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:14.907512 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a36bde4-e796-43e2-bb9a-468518b985a5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:14.907981 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a36bde4-e796-43e2-bb9a-468518b985a5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:14.908580 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a36bde4-e796-43e2-bb9a-468518b985a5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:14.922709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-0a36bde4-e796-43e2-bb9a-468518b985a5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] HTTP exception thrown: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0a36bde4-e796-43e2-bb9a-468518b985a5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Request method failure captured: Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 HTTP/1.1 Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxbJlDK1uY-9wqLqihMbwRqesNGVCWX4DheM5VLJrOjTR46vBOGSHxQrZllJKbAVqUcrCrtjQXWEHIO6-XCvfuvjcl9yH54l2HLzoxuiB6jt_hZqeF-IoIpGa8umora8AXWsLgKIbyBUgggic1ZEp_39A7UCBRbZ1VYQo-hgHjfu66c Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: e27e3216211942959311372c2d078202 Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:49:14.924420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:49:14.926031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e27e3216211942959311372c2d078202", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e27e3216211942959311372c2d078202"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e27e3216211942959311372c2d078202"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e27e3216211942959311372c2d078202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:49:14.926031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:49:14.926031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: e27e3216211942959311372c2d078202 Aug 22 05:49:14.926031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:49:14.926031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-AttachVolumeShelveTestJSON-2055896554-project Aug 22 05:49:14.926031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:49:14.926031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:49:14.926031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: 2864050fd1a64646a8760f0172be8f4a Aug 22 05:49:14.926031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2055896554-project Aug 22 05:49:14.926031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:49:14.926031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. Aug 22 05:49:14.926031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': 'd64c75c4-9ba2-408f-8bbe-299f7888d6c9'} Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:49:14.927132 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. Aug 22 05:49:14.928456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:49:14.930082 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0a36bde4-e796-43e2-bb9a-468518b985a5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Returning 404 to user: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:49:14.930082 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0a36bde4-e796-43e2-bb9a-468518b985a5 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 404 len: 111 microversion: 2.20 time: 0.031350 Aug 22 05:49:14.930082 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 462/914] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:49:14 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 05:49:14.937942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-67597362-62d2-4ea6-a5c3-fb42c8108109 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '.version_select at 0x7f0b3dd84550>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:14.961680 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-67597362-62d2-4ea6-a5c3-fb42c8108109 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1168388050" status: 204 len: 0 microversion: 2.20 time: 0.030247 Aug 22 05:49:14.962313 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 453/915] 10.222.0.18 () {60 vars in 1262 bytes} [Mon Aug 22 05:49:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1168388050 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 05:49:16.787450 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a9387067-e642-429b-a41c-a5c669f1ec52 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:16.787991 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a9387067-e642-429b-a41c-a5c669f1ec52 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:16.795100 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a9387067-e642-429b-a41c-a5c669f1ec52 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:16.795590 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a9387067-e642-429b-a41c-a5c669f1ec52 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:16.796030 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a9387067-e642-429b-a41c-a5c669f1ec52 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:16.796709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a9387067-e642-429b-a41c-a5c669f1ec52 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:16.797192 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a9387067-e642-429b-a41c-a5c669f1ec52 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:16.797612 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a9387067-e642-429b-a41c-a5c669f1ec52 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:16.812567 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-a9387067-e642-429b-a41c-a5c669f1ec52 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] HTTP exception thrown: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a9387067-e642-429b-a41c-a5c669f1ec52 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Request method failure captured: Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: DELETE /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 HTTP/1.1 Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxbJlDK1uY-9wqLqihMbwRqesNGVCWX4DheM5VLJrOjTR46vBOGSHxQrZllJKbAVqUcrCrtjQXWEHIO6-XCvfuvjcl9yH54l2HLzoxuiB6jt_hZqeF-IoIpGa8umora8AXWsLgKIbyBUgggic1ZEp_39A7UCBRbZ1VYQo-hgHjfu66c Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: e27e3216211942959311372c2d078202 Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:49:16.814131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:49:16.815542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e27e3216211942959311372c2d078202", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e27e3216211942959311372c2d078202"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e27e3216211942959311372c2d078202"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e27e3216211942959311372c2d078202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:49:16.815542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:49:16.815542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: e27e3216211942959311372c2d078202 Aug 22 05:49:16.815542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:49:16.815542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-AttachVolumeShelveTestJSON-2055896554-project Aug 22 05:49:16.815542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:49:16.815542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:49:16.815542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: 2864050fd1a64646a8760f0172be8f4a Aug 22 05:49:16.815542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2055896554-project Aug 22 05:49:16.815542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:49:16.815542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. Aug 22 05:49:16.815542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': 'd64c75c4-9ba2-408f-8bbe-299f7888d6c9'} Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:49:16.816513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. Aug 22 05:49:16.817807 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:49:16.819296 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a9387067-e642-429b-a41c-a5c669f1ec52 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Returning 404 to user: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:49:16.819296 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a9387067-e642-429b-a41c-a5c669f1ec52 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 404 len: 111 microversion: 2.20 time: 0.031981 Aug 22 05:49:16.819296 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 463/916] 10.222.0.18 () {60 vars in 1280 bytes} [Mon Aug 22 05:49:16 2022] DELETE /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 05:49:16.826128 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-90fad2a8-20c0-44e0-b29f-ad853de17197 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:16.826889 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-90fad2a8-20c0-44e0-b29f-ad853de17197 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: d64c75c4-9ba2-408f-8bbe-299f7888d6c9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:16.834041 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90fad2a8-20c0-44e0-b29f-ad853de17197 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:16.834494 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90fad2a8-20c0-44e0-b29f-ad853de17197 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:16.834930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90fad2a8-20c0-44e0-b29f-ad853de17197 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:16.835640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90fad2a8-20c0-44e0-b29f-ad853de17197 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:16.836092 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90fad2a8-20c0-44e0-b29f-ad853de17197 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:16.836508 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90fad2a8-20c0-44e0-b29f-ad853de17197 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:16.850327 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-90fad2a8-20c0-44e0-b29f-ad853de17197 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] HTTP exception thrown: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-90fad2a8-20c0-44e0-b29f-ad853de17197 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Request method failure captured: Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 HTTP/1.1 Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxbJlDK1uY-9wqLqihMbwRqesNGVCWX4DheM5VLJrOjTR46vBOGSHxQrZllJKbAVqUcrCrtjQXWEHIO6-XCvfuvjcl9yH54l2HLzoxuiB6jt_hZqeF-IoIpGa8umora8AXWsLgKIbyBUgggic1ZEp_39A7UCBRbZ1VYQo-hgHjfu66c Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: e27e3216211942959311372c2d078202 Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:49:16.851975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:49:16.853546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e27e3216211942959311372c2d078202", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e27e3216211942959311372c2d078202"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e27e3216211942959311372c2d078202"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e27e3216211942959311372c2d078202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:49:16.853546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:49:16.853546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: e27e3216211942959311372c2d078202 Aug 22 05:49:16.853546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:49:16.853546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeShelveTestJSON-2055896554-project Aug 22 05:49:16.853546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:49:16.853546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:49:16.853546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 2864050fd1a64646a8760f0172be8f4a Aug 22 05:49:16.853546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2055896554-project Aug 22 05:49:16.853546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:49:16.853546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. Aug 22 05:49:16.853546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': 'd64c75c4-9ba2-408f-8bbe-299f7888d6c9'} Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:49:16.855163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. Aug 22 05:49:16.856425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:49:16.857852 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-90fad2a8-20c0-44e0-b29f-ad853de17197 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Returning 404 to user: Instance d64c75c4-9ba2-408f-8bbe-299f7888d6c9 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:49:16.857852 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-90fad2a8-20c0-44e0-b29f-ad853de17197 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9" status: 404 len: 111 microversion: 2.20 time: 0.032726 Aug 22 05:49:16.857852 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 454/917] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:49:16 2022] GET /compute/v2.1/servers/d64c75c4-9ba2-408f-8bbe-299f7888d6c9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 05:49:18.012896 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0a290659-de9d-401e-abb8-9203f46f8d42 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:18.013364 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0a290659-de9d-401e-abb8-9203f46f8d42 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:18.020310 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a290659-de9d-401e-abb8-9203f46f8d42 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:18.020785 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a290659-de9d-401e-abb8-9203f46f8d42 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:18.021211 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a290659-de9d-401e-abb8-9203f46f8d42 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:18.021903 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a290659-de9d-401e-abb8-9203f46f8d42 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:18.022345 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a290659-de9d-401e-abb8-9203f46f8d42 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:18.022764 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0a290659-de9d-401e-abb8-9203f46f8d42 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:18.036834 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-0a290659-de9d-401e-abb8-9203f46f8d42 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] HTTP exception thrown: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0a290659-de9d-401e-abb8-9203f46f8d42 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Request method failure captured: Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: DELETE /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb HTTP/1.1 Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxbJlDK1uY-9wqLqihMbwRqesNGVCWX4DheM5VLJrOjTR46vBOGSHxQrZllJKbAVqUcrCrtjQXWEHIO6-XCvfuvjcl9yH54l2HLzoxuiB6jt_hZqeF-IoIpGa8umora8AXWsLgKIbyBUgggic1ZEp_39A7UCBRbZ1VYQo-hgHjfu66c Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: e27e3216211942959311372c2d078202 Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:49:18.038391 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:49:18.040121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e27e3216211942959311372c2d078202", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e27e3216211942959311372c2d078202"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e27e3216211942959311372c2d078202"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e27e3216211942959311372c2d078202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:49:18.040121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:49:18.040121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: e27e3216211942959311372c2d078202 Aug 22 05:49:18.040121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:49:18.040121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-AttachVolumeShelveTestJSON-2055896554-project Aug 22 05:49:18.040121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:49:18.040121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:49:18.040121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: 2864050fd1a64646a8760f0172be8f4a Aug 22 05:49:18.040121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2055896554-project Aug 22 05:49:18.040121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:49:18.040121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. Aug 22 05:49:18.040121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': '64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb'} Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:49:18.041191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. Aug 22 05:49:18.042664 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:49:18.044543 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0a290659-de9d-401e-abb8-9203f46f8d42 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Returning 404 to user: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:49:18.044543 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0a290659-de9d-401e-abb8-9203f46f8d42 tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "DELETE /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 404 len: 111 microversion: 2.20 time: 0.030801 Aug 22 05:49:18.044543 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 464/918] 10.222.0.18 () {60 vars in 1280 bytes} [Mon Aug 22 05:49:18 2022] DELETE /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 05:49:18.048533 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a48191e2-3ac5-40d2-b94f-0d0f017d995d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:18.049143 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a48191e2-3ac5-40d2-b94f-0d0f017d995d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] [instance: 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:18.056120 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a48191e2-3ac5-40d2-b94f-0d0f017d995d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:18.056603 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a48191e2-3ac5-40d2-b94f-0d0f017d995d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:18.058580 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a48191e2-3ac5-40d2-b94f-0d0f017d995d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:18.060893 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a48191e2-3ac5-40d2-b94f-0d0f017d995d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:18.061348 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a48191e2-3ac5-40d2-b94f-0d0f017d995d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:18.061774 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a48191e2-3ac5-40d2-b94f-0d0f017d995d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:18.076911 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-a48191e2-3ac5-40d2-b94f-0d0f017d995d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] HTTP exception thrown: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a48191e2-3ac5-40d2-b94f-0d0f017d995d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Request method failure captured: Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb HTTP/1.1 Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxbJlDK1uY-9wqLqihMbwRqesNGVCWX4DheM5VLJrOjTR46vBOGSHxQrZllJKbAVqUcrCrtjQXWEHIO6-XCvfuvjcl9yH54l2HLzoxuiB6jt_hZqeF-IoIpGa8umora8AXWsLgKIbyBUgggic1ZEp_39A7UCBRbZ1VYQo-hgHjfu66c Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: e27e3216211942959311372c2d078202 Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:49:18.078427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:49:18.080101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e27e3216211942959311372c2d078202", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e27e3216211942959311372c2d078202"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e27e3216211942959311372c2d078202"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e27e3216211942959311372c2d078202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:49:18.080101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:49:18.080101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: e27e3216211942959311372c2d078202 Aug 22 05:49:18.080101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2055896554 Aug 22 05:49:18.080101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeShelveTestJSON-2055896554-project Aug 22 05:49:18.080101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:49:18.080101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:49:18.080101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 2864050fd1a64646a8760f0172be8f4a Aug 22 05:49:18.080101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2055896554-project Aug 22 05:49:18.080101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:49:18.080101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. Aug 22 05:49:18.080101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb'} Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:49:18.081059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. Aug 22 05:49:18.082496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:49:18.083949 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a48191e2-3ac5-40d2-b94f-0d0f017d995d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] Returning 404 to user: Instance 64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:49:18.083949 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a48191e2-3ac5-40d2-b94f-0d0f017d995d tempest-AttachVolumeShelveTestJSON-2055896554 tempest-AttachVolumeShelveTestJSON-2055896554-project] 10.222.0.18 "GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb" status: 404 len: 111 microversion: 2.20 time: 0.035244 Aug 22 05:49:18.083949 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 455/919] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 22 05:49:18 2022] GET /compute/v2.1/servers/64a2ec11-90dc-4d86-8ab6-e30bdb6c26eb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 05:49:26.998464 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8d2d7a0f-af3e-44f3-b607-ea31daf3667c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:26.999080 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8d2d7a0f-af3e-44f3-b607-ea31daf3667c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:27.007061 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8d2d7a0f-af3e-44f3-b607-ea31daf3667c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:27.007630 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8d2d7a0f-af3e-44f3-b607-ea31daf3667c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:27.008149 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8d2d7a0f-af3e-44f3-b607-ea31daf3667c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:27.008936 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8d2d7a0f-af3e-44f3-b607-ea31daf3667c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:27.009438 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8d2d7a0f-af3e-44f3-b607-ea31daf3667c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:27.009930 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8d2d7a0f-af3e-44f3-b607-ea31daf3667c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:27.037831 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8d2d7a0f-af3e-44f3-b607-ea31daf3667c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333/ips" status: 200 len: 149 microversion: 2.1 time: 0.044911 Aug 22 05:49:27.038434 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 465/920] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 22 05:49:26 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:49:28.434076 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ee40d466-63ed-4f48-beeb-ce309088a195 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99d0a842-6256-4e89-9666-98b0cd2a30bc"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:49:28.436430 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ee40d466-63ed-4f48-beeb-ce309088a195 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:28.439244 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:49:28.440098 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:49:28.449523 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee40d466-63ed-4f48-beeb-ce309088a195 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:28.449809 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee40d466-63ed-4f48-beeb-ce309088a195 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:28.450207 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee40d466-63ed-4f48-beeb-ce309088a195 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:28.450895 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee40d466-63ed-4f48-beeb-ce309088a195 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:28.451330 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee40d466-63ed-4f48-beeb-ce309088a195 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:28.451781 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee40d466-63ed-4f48-beeb-ce309088a195 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:28.711359 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ee40d466-63ed-4f48-beeb-ce309088a195 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "POST /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281984 Aug 22 05:49:28.712021 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 456/921] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 22 05:49:28 2022] POST /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:49:36.265780 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4c1c4491-91e5-4ca5-80f5-042d0e197070 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Action: 'create', calling method: .version_select at 0x7f0b42699d30>, body: {"keypair": {"name": "tempest-keypair-1115072321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoCC74UcDyKvtodioKhadr+d4F66YHojrpzxcrZMl+/vD+9WagDohOtU1FQ8lOuYrpZAX26JXvTVLQW3RA0sLS2QO+zjPsmPZccnRwGiNlnej6jfxLH6a9nB8ThfASgrg=="}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:49:36.287755 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-4c1c4491-91e5-4ca5-80f5-042d0e197070 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Getting quotas for project fae948b0baa04f2eb07b2aee2785dcdd. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:49:36.292150 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-4c1c4491-91e5-4ca5-80f5-042d0e197070 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Getting quotas for user ed76a574d2fc4bd8a1f1176d0fef86e2 and project fae948b0baa04f2eb07b2aee2785dcdd. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:49:36.319726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4c1c4491-91e5-4ca5-80f5-042d0e197070 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058577 Aug 22 05:49:36.320420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 466/922] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 22 05:49:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:49:37.986874 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-472989535", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "01c51a10-ff3b-4b62-bd4e-eb6912d3a3c6"}], "security_groups": [{"name": "tempest-securitygroup--930586999"}], "key_name": "tempest-keypair-1115072321", "user_data": "}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:49:38.097059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] validate_networks() for [('01c51a10-ff3b-4b62-bd4e-eb6912d3a3c6', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:49:38.616801 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:49:38.617225 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:49:38.617693 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:49:38.618093 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:49:38.618499 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:49:38.628356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:38.628836 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:38.629263 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:38.629986 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:38.630432 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:38.630853 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:38.648392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Getting quotas for project fae948b0baa04f2eb07b2aee2785dcdd. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:49:38.652857 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Getting quotas for user ed76a574d2fc4bd8a1f1176d0fef86e2 and project fae948b0baa04f2eb07b2aee2785dcdd. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:49:38.665207 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:49:38.667607 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:49:38.721047 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f540cf2e-d582-4398-b917-17b67b87dda9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.739846 Aug 22 05:49:38.721701 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 457/923] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:49:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:49:38.732795 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-cc1adf93-e8a2-48d9-975d-4880f72a5897 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:38.733525 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-cc1adf93-e8a2-48d9-975d-4880f72a5897 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:38.735726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=28 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:49:38.790924 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-cc1adf93-e8a2-48d9-975d-4880f72a5897 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:38.798545 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-cc1adf93-e8a2-48d9-975d-4880f72a5897 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 200 len: 1241 microversion: 2.1 time: 0.069731 Aug 22 05:49:38.799117 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 467/924] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:49:38 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:49:39.819735 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-41c5e1d2-18a3-4406-a90e-de3ce0d9dcf9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:39.820532 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-41c5e1d2-18a3-4406-a90e-de3ce0d9dcf9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:39.827969 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41c5e1d2-18a3-4406-a90e-de3ce0d9dcf9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:39.828546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41c5e1d2-18a3-4406-a90e-de3ce0d9dcf9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:39.829219 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41c5e1d2-18a3-4406-a90e-de3ce0d9dcf9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:39.829992 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41c5e1d2-18a3-4406-a90e-de3ce0d9dcf9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:39.830507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41c5e1d2-18a3-4406-a90e-de3ce0d9dcf9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:39.830989 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41c5e1d2-18a3-4406-a90e-de3ce0d9dcf9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:39.898118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-41c5e1d2-18a3-4406-a90e-de3ce0d9dcf9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:39.909998 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-41c5e1d2-18a3-4406-a90e-de3ce0d9dcf9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 200 len: 1301 microversion: 2.1 time: 0.094752 Aug 22 05:49:39.910585 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 458/925] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:49:39 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 1301 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:49:40.933997 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-869d9971-9e11-4931-84d5-f72dfd449323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:40.934610 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-869d9971-9e11-4931-84d5-f72dfd449323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:40.942494 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-869d9971-9e11-4931-84d5-f72dfd449323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:40.942853 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-869d9971-9e11-4931-84d5-f72dfd449323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:40.943286 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-869d9971-9e11-4931-84d5-f72dfd449323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:40.944023 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-869d9971-9e11-4931-84d5-f72dfd449323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:40.944475 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-869d9971-9e11-4931-84d5-f72dfd449323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:40.944896 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-869d9971-9e11-4931-84d5-f72dfd449323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:41.101074 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-869d9971-9e11-4931-84d5-f72dfd449323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:41.110588 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-869d9971-9e11-4931-84d5-f72dfd449323 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 200 len: 1366 microversion: 2.1 time: 0.181871 Aug 22 05:49:41.115599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 468/926] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:49:40 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:49:41.233182 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-89998940-e58d-49a0-9cc5-a0227063826c req-83bac1bd-02be-45f9-a99a-2a2b6acf0c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c74c55-3079-4099-9b60-2146b6ad9e5e", "tag": "f5fea5b6-7b00-4258-8337-940a7401a2bb"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:49:41.253774 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-89998940-e58d-49a0-9cc5-a0227063826c req-83bac1bd-02be-45f9-a99a-2a2b6acf0c0a service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:41.254396 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-89998940-e58d-49a0-9cc5-a0227063826c req-83bac1bd-02be-45f9-a99a-2a2b6acf0c0a service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:41.256501 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-89998940-e58d-49a0-9cc5-a0227063826c req-83bac1bd-02be-45f9-a99a-2a2b6acf0c0a service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:41.271300 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-89998940-e58d-49a0-9cc5-a0227063826c req-83bac1bd-02be-45f9-a99a-2a2b6acf0c0a service nova] Creating event network-changed:f5fea5b6-7b00-4258-8337-940a7401a2bb for instance 38c74c55-3079-4099-9b60-2146b6ad9e5e on hv-cinder-85391 Aug 22 05:49:41.277404 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-89998940-e58d-49a0-9cc5-a0227063826c req-83bac1bd-02be-45f9-a99a-2a2b6acf0c0a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048455 Aug 22 05:49:41.278275 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 459/927] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:49:42.132007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0afb9e15-7e54-4e26-9def-c822e5ce811a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:42.132703 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0afb9e15-7e54-4e26-9def-c822e5ce811a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:42.135118 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:49:42.140825 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0afb9e15-7e54-4e26-9def-c822e5ce811a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:42.141293 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0afb9e15-7e54-4e26-9def-c822e5ce811a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:42.141840 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0afb9e15-7e54-4e26-9def-c822e5ce811a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:42.142791 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0afb9e15-7e54-4e26-9def-c822e5ce811a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:42.143341 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0afb9e15-7e54-4e26-9def-c822e5ce811a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:42.143679 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0afb9e15-7e54-4e26-9def-c822e5ce811a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:42.277024 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0afb9e15-7e54-4e26-9def-c822e5ce811a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:42.285263 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0afb9e15-7e54-4e26-9def-c822e5ce811a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 200 len: 1366 microversion: 2.1 time: 0.157170 Aug 22 05:49:42.285939 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 469/928] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:49:42 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:49:43.307745 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-28e726b7-293f-4b4f-b1ae-8434144ae7fd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:43.308436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-28e726b7-293f-4b4f-b1ae-8434144ae7fd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:43.314863 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-28e726b7-293f-4b4f-b1ae-8434144ae7fd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:43.315335 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-28e726b7-293f-4b4f-b1ae-8434144ae7fd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:43.315784 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-28e726b7-293f-4b4f-b1ae-8434144ae7fd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:43.316684 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-28e726b7-293f-4b4f-b1ae-8434144ae7fd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:43.317121 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-28e726b7-293f-4b4f-b1ae-8434144ae7fd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:43.317529 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-28e726b7-293f-4b4f-b1ae-8434144ae7fd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:43.504839 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-28e726b7-293f-4b4f-b1ae-8434144ae7fd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:43.515412 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-28e726b7-293f-4b4f-b1ae-8434144ae7fd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 200 len: 1366 microversion: 2.1 time: 0.212368 Aug 22 05:49:43.536605 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 460/929] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:49:43 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:49:44.536040 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-99e406cc-3e84-44d9-961e-94a7cabbcecb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:44.536565 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-99e406cc-3e84-44d9-961e-94a7cabbcecb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:44.543200 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-99e406cc-3e84-44d9-961e-94a7cabbcecb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:44.543709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-99e406cc-3e84-44d9-961e-94a7cabbcecb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:44.544135 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-99e406cc-3e84-44d9-961e-94a7cabbcecb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:44.544822 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-99e406cc-3e84-44d9-961e-94a7cabbcecb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:44.545262 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-99e406cc-3e84-44d9-961e-94a7cabbcecb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:44.545676 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-99e406cc-3e84-44d9-961e-94a7cabbcecb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:44.683771 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-99e406cc-3e84-44d9-961e-94a7cabbcecb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:44.692495 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-99e406cc-3e84-44d9-961e-94a7cabbcecb tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 200 len: 1366 microversion: 2.1 time: 0.160496 Aug 22 05:49:44.693062 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 470/930] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:49:44 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:49:45.714425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-56352261-5122-40e8-9a10-fdd1caa27291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:45.715098 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-56352261-5122-40e8-9a10-fdd1caa27291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:45.721815 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56352261-5122-40e8-9a10-fdd1caa27291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:45.722390 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56352261-5122-40e8-9a10-fdd1caa27291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:45.723653 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56352261-5122-40e8-9a10-fdd1caa27291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:45.724334 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56352261-5122-40e8-9a10-fdd1caa27291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:45.724796 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56352261-5122-40e8-9a10-fdd1caa27291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:45.725209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56352261-5122-40e8-9a10-fdd1caa27291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:45.871039 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-56352261-5122-40e8-9a10-fdd1caa27291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:45.880824 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-56352261-5122-40e8-9a10-fdd1caa27291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 200 len: 1366 microversion: 2.1 time: 0.170752 Aug 22 05:49:45.895963 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 461/931] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:49:45 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:49:46.902350 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b7ad55e6-9dac-4842-a4a8-78698f67d4d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:46.902995 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b7ad55e6-9dac-4842-a4a8-78698f67d4d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:46.909803 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7ad55e6-9dac-4842-a4a8-78698f67d4d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:46.910289 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7ad55e6-9dac-4842-a4a8-78698f67d4d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:46.910710 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7ad55e6-9dac-4842-a4a8-78698f67d4d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:46.911700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7ad55e6-9dac-4842-a4a8-78698f67d4d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:46.912153 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7ad55e6-9dac-4842-a4a8-78698f67d4d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:46.912584 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7ad55e6-9dac-4842-a4a8-78698f67d4d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:47.059550 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b7ad55e6-9dac-4842-a4a8-78698f67d4d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:47.069570 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b7ad55e6-9dac-4842-a4a8-78698f67d4d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 200 len: 1366 microversion: 2.1 time: 0.171044 Aug 22 05:49:47.071334 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 471/932] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:49:46 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:49:48.094385 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-73963d45-adc5-4618-a8b8-058667e39803 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:48.095958 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-73963d45-adc5-4618-a8b8-058667e39803 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:48.103087 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73963d45-adc5-4618-a8b8-058667e39803 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:48.103789 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73963d45-adc5-4618-a8b8-058667e39803 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:48.104498 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73963d45-adc5-4618-a8b8-058667e39803 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:48.105175 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73963d45-adc5-4618-a8b8-058667e39803 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:48.105793 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73963d45-adc5-4618-a8b8-058667e39803 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:48.106201 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73963d45-adc5-4618-a8b8-058667e39803 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:48.376803 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-73963d45-adc5-4618-a8b8-058667e39803 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:48.390163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-73963d45-adc5-4618-a8b8-058667e39803 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 200 len: 1366 microversion: 2.1 time: 0.299946 Aug 22 05:49:48.391226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 462/933] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:49:48 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:49:48.724312 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-b5939255-9273-448e-89a1-ed61ccac6b57 req-8d6258bc-5cd7-46a2-bc9c-a282b99e887d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c74c55-3079-4099-9b60-2146b6ad9e5e", "name": "network-vif-plugged", "status": "completed", "tag": "f5fea5b6-7b00-4258-8337-940a7401a2bb"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:49:48.743511 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b5939255-9273-448e-89a1-ed61ccac6b57 req-8d6258bc-5cd7-46a2-bc9c-a282b99e887d service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:48.744055 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b5939255-9273-448e-89a1-ed61ccac6b57 req-8d6258bc-5cd7-46a2-bc9c-a282b99e887d service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:48.745160 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b5939255-9273-448e-89a1-ed61ccac6b57 req-8d6258bc-5cd7-46a2-bc9c-a282b99e887d service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:48.759110 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-b5939255-9273-448e-89a1-ed61ccac6b57 req-8d6258bc-5cd7-46a2-bc9c-a282b99e887d service nova] Creating event network-vif-plugged:f5fea5b6-7b00-4258-8337-940a7401a2bb for instance 38c74c55-3079-4099-9b60-2146b6ad9e5e on hv-cinder-85391 Aug 22 05:49:48.764327 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-b5939255-9273-448e-89a1-ed61ccac6b57 req-8d6258bc-5cd7-46a2-bc9c-a282b99e887d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193444 Aug 22 05:49:48.765155 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 472/934] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:49:49.412827 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-679c450f-abaa-4e5d-85c1-956e9e39987c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:49.413472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-679c450f-abaa-4e5d-85c1-956e9e39987c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:49.416540 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:49:49.417411 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=6 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:49:49.422416 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-679c450f-abaa-4e5d-85c1-956e9e39987c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:49.422893 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-679c450f-abaa-4e5d-85c1-956e9e39987c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:49.423312 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-679c450f-abaa-4e5d-85c1-956e9e39987c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:49.424110 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-679c450f-abaa-4e5d-85c1-956e9e39987c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:49.424551 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-679c450f-abaa-4e5d-85c1-956e9e39987c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:49.424962 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-679c450f-abaa-4e5d-85c1-956e9e39987c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:49.582068 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-679c450f-abaa-4e5d-85c1-956e9e39987c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:49.590730 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-679c450f-abaa-4e5d-85c1-956e9e39987c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 200 len: 1366 microversion: 2.1 time: 0.181885 Aug 22 05:49:49.591521 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 463/935] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:49:49 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:49:50.625549 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-40f7f398-78e4-4931-b1c0-b6cc351df2a3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:50.628537 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-40f7f398-78e4-4931-b1c0-b6cc351df2a3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:50.637640 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=6 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:49:50.658369 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-40f7f398-78e4-4931-b1c0-b6cc351df2a3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:50.659948 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-40f7f398-78e4-4931-b1c0-b6cc351df2a3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:50.660561 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-40f7f398-78e4-4931-b1c0-b6cc351df2a3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:50.661436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-40f7f398-78e4-4931-b1c0-b6cc351df2a3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:50.662034 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-40f7f398-78e4-4931-b1c0-b6cc351df2a3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:50.662602 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-40f7f398-78e4-4931-b1c0-b6cc351df2a3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:50.829632 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-40f7f398-78e4-4931-b1c0-b6cc351df2a3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:50.837923 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-40f7f398-78e4-4931-b1c0-b6cc351df2a3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 200 len: 1366 microversion: 2.1 time: 0.228061 Aug 22 05:49:50.839663 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 473/936] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:49:50 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:49:51.861628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-cc7e75d3-f177-4f6e-b26d-0237832a0b91 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:51.862883 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-cc7e75d3-f177-4f6e-b26d-0237832a0b91 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:51.872028 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc7e75d3-f177-4f6e-b26d-0237832a0b91 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:51.872516 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc7e75d3-f177-4f6e-b26d-0237832a0b91 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:51.872935 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc7e75d3-f177-4f6e-b26d-0237832a0b91 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:51.873940 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc7e75d3-f177-4f6e-b26d-0237832a0b91 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:51.874528 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc7e75d3-f177-4f6e-b26d-0237832a0b91 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:51.875086 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc7e75d3-f177-4f6e-b26d-0237832a0b91 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:52.026212 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-cc7e75d3-f177-4f6e-b26d-0237832a0b91 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:49:52.036738 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-cc7e75d3-f177-4f6e-b26d-0237832a0b91 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 200 len: 1556 microversion: 2.1 time: 0.179451 Aug 22 05:49:52.037696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 464/937] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:49:51 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 1556 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:49:52.062514 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-dab4b3a5-410a-4f26-847c-9525c22b240a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:49:52.065149 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-dab4b3a5-410a-4f26-847c-9525c22b240a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:49:52.081638 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dab4b3a5-410a-4f26-847c-9525c22b240a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:52.082749 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dab4b3a5-410a-4f26-847c-9525c22b240a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:52.083744 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dab4b3a5-410a-4f26-847c-9525c22b240a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:52.085041 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dab4b3a5-410a-4f26-847c-9525c22b240a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:52.085682 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dab4b3a5-410a-4f26-847c-9525c22b240a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:52.087192 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dab4b3a5-410a-4f26-847c-9525c22b240a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:52.185470 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-dab4b3a5-410a-4f26-847c-9525c22b240a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128119 Aug 22 05:49:52.186483 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 474/938] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Aug 22 05:49:52 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:49:54.416814 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-3abf1e09-716f-44c5-aec7-7945828a3e3f req-9cdc4c28-0a03-4297-aea5-c1c59bf4f5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c74c55-3079-4099-9b60-2146b6ad9e5e", "tag": "f5fea5b6-7b00-4258-8337-940a7401a2bb"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:49:54.434044 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-3abf1e09-716f-44c5-aec7-7945828a3e3f req-9cdc4c28-0a03-4297-aea5-c1c59bf4f5f7 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:49:54.434912 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-3abf1e09-716f-44c5-aec7-7945828a3e3f req-9cdc4c28-0a03-4297-aea5-c1c59bf4f5f7 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:49:54.435563 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-3abf1e09-716f-44c5-aec7-7945828a3e3f req-9cdc4c28-0a03-4297-aea5-c1c59bf4f5f7 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:49:54.463456 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-3abf1e09-716f-44c5-aec7-7945828a3e3f req-9cdc4c28-0a03-4297-aea5-c1c59bf4f5f7 service nova] Creating event network-changed:f5fea5b6-7b00-4258-8337-940a7401a2bb for instance 38c74c55-3079-4099-9b60-2146b6ad9e5e on hv-cinder-85391 Aug 22 05:49:54.473726 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-3abf1e09-716f-44c5-aec7-7945828a3e3f req-9cdc4c28-0a03-4297-aea5-c1c59bf4f5f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.476107 Aug 22 05:49:54.475301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 465/939] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:49:54.835431 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-aaffd168-fcb9-4036-a208-f20ff924ef5d tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Action: 'create', calling method: .version_select at 0x7f0b426edca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1539589973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcrtP+LFQ1/JD4tAhCviUGKhe9kFEeEm3S3WdULiWE7JeF9rwXHNtSEVatEuf+msFn6LpOLt9ghNMmtfayT27t2pHm1zia9LVlHdlc4mZqJUcV764Z5S4JgNBq319FBzg=="}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:49:54.860419 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-aaffd168-fcb9-4036-a208-f20ff924ef5d tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Getting quotas for project 6d3a9f50ec2d4fff938fcd6a79f5cdc9. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:49:54.865787 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-aaffd168-fcb9-4036-a208-f20ff924ef5d tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Getting quotas for user bb6d35f57b804ba5afa4ab86c46cd7c3 and project 6d3a9f50ec2d4fff938fcd6a79f5cdc9. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:49:54.908656 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-aaffd168-fcb9-4036-a208-f20ff924ef5d tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.287831 Aug 22 05:49:54.910379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 475/940] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 22 05:49:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:50:16.948528 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:16.949290 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:16.953383 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1927439733", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1539589973", "security_groups": [{"name": "tempest-secgroup-smoke-727561452"}], "block_device_mapping_v2": [{"uuid": "7d96dbc0-974b-403b-bb42-12b77e8bddf7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eaf2e3cb-8f86-46d8-9db4-d025de139d15"}]}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:50:17.073891 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] validate_networks() for [('eaf2e3cb-8f86-46d8-9db4-d025de139d15', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:50:17.459966 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:50:17.460503 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:50:17.461159 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:50:17.461699 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:50:17.462288 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:50:17.476566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:17.477240 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:17.477772 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:17.478802 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:17.479391 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:17.480013 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:17.499702 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Getting quotas for project 6d3a9f50ec2d4fff938fcd6a79f5cdc9. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:50:17.503866 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Getting quotas for user bb6d35f57b804ba5afa4ab86c46cd7c3 and project 6d3a9f50ec2d4fff938fcd6a79f5cdc9. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:50:17.560504 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:50:17.562735 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d96dbc0-974b-403b-bb42-12b77e8bddf7',volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:50:17.714695 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9b611328-2b60-4634-ad2d-39ca67f19802 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.767628 Aug 22 05:50:17.715269 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 466/941] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:50:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:50:17.726648 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-2062fee8-2846-46ca-bb74-66cf10d16e39 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:17.727286 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-2062fee8-2846-46ca-bb74-66cf10d16e39 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:17.729292 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=36 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:17.730101 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=4 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:17.730602 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:17.787276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-2062fee8-2846-46ca-bb74-66cf10d16e39 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:17.794307 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-2062fee8-2846-46ca-bb74-66cf10d16e39 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1095 microversion: 2.1 time: 0.071831 Aug 22 05:50:17.794883 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 476/942] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:17 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:50:18.817270 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4beb82d0-2cfc-455c-8db7-a34f2788717e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:18.818852 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4beb82d0-2cfc-455c-8db7-a34f2788717e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:18.826816 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4beb82d0-2cfc-455c-8db7-a34f2788717e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:18.827294 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4beb82d0-2cfc-455c-8db7-a34f2788717e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:18.827753 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4beb82d0-2cfc-455c-8db7-a34f2788717e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:18.828449 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4beb82d0-2cfc-455c-8db7-a34f2788717e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:18.828896 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4beb82d0-2cfc-455c-8db7-a34f2788717e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:18.829312 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4beb82d0-2cfc-455c-8db7-a34f2788717e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:18.893143 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4beb82d0-2cfc-455c-8db7-a34f2788717e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:18.906307 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4beb82d0-2cfc-455c-8db7-a34f2788717e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1211 microversion: 2.1 time: 0.094173 Aug 22 05:50:18.906900 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 467/943] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:18 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1211 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:50:19.928474 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ba83c751-14ae-49b5-9857-e94899efd27d tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:19.929122 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ba83c751-14ae-49b5-9857-e94899efd27d tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:19.936062 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba83c751-14ae-49b5-9857-e94899efd27d tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:19.936540 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba83c751-14ae-49b5-9857-e94899efd27d tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:19.937001 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba83c751-14ae-49b5-9857-e94899efd27d tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:19.937688 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba83c751-14ae-49b5-9857-e94899efd27d tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:19.938129 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba83c751-14ae-49b5-9857-e94899efd27d tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:19.938541 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba83c751-14ae-49b5-9857-e94899efd27d tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:20.078050 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ba83c751-14ae-49b5-9857-e94899efd27d tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:20.078655 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-22499a9c-529e-4737-a1ca-5210227547c1 req-8acd72c6-1a6a-47a5-ad8b-03e9e3b02989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c38dec1b-72b3-49d9-a7cc-aeb7883bae61", "tag": "47de31c9-e5de-48fc-bc8d-c30da7ad0fa4"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:50:20.086560 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ba83c751-14ae-49b5-9857-e94899efd27d tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1266 microversion: 2.1 time: 0.162264 Aug 22 05:50:20.087262 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 477/944] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:19 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:50:20.096184 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-22499a9c-529e-4737-a1ca-5210227547c1 req-8acd72c6-1a6a-47a5-ad8b-03e9e3b02989 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:20.096371 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-22499a9c-529e-4737-a1ca-5210227547c1 req-8acd72c6-1a6a-47a5-ad8b-03e9e3b02989 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:20.096790 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-22499a9c-529e-4737-a1ca-5210227547c1 req-8acd72c6-1a6a-47a5-ad8b-03e9e3b02989 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:20.109445 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-22499a9c-529e-4737-a1ca-5210227547c1 req-8acd72c6-1a6a-47a5-ad8b-03e9e3b02989 service nova] Creating event network-changed:47de31c9-e5de-48fc-bc8d-c30da7ad0fa4 for instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 on hv-cinder-85391 Aug 22 05:50:20.114312 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-22499a9c-529e-4737-a1ca-5210227547c1 req-8acd72c6-1a6a-47a5-ad8b-03e9e3b02989 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039948 Aug 22 05:50:20.114914 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 468/945] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:50:21.110192 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e5b3f04c-253f-412c-9275-f150f2efcb45 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:21.110953 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e5b3f04c-253f-412c-9275-f150f2efcb45 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:21.118641 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e5b3f04c-253f-412c-9275-f150f2efcb45 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:21.119146 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e5b3f04c-253f-412c-9275-f150f2efcb45 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:21.119601 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e5b3f04c-253f-412c-9275-f150f2efcb45 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:21.120261 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e5b3f04c-253f-412c-9275-f150f2efcb45 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:21.120721 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e5b3f04c-253f-412c-9275-f150f2efcb45 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:21.121130 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e5b3f04c-253f-412c-9275-f150f2efcb45 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:21.255295 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e5b3f04c-253f-412c-9275-f150f2efcb45 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:21.263426 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e5b3f04c-253f-412c-9275-f150f2efcb45 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1266 microversion: 2.1 time: 0.158906 Aug 22 05:50:21.264034 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 478/946] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:21 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:50:22.288660 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d2d0c470-d2ff-4e6f-8917-173f2047f1fe tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:22.289413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d2d0c470-d2ff-4e6f-8917-173f2047f1fe tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:22.297798 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2d0c470-d2ff-4e6f-8917-173f2047f1fe tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:22.298475 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2d0c470-d2ff-4e6f-8917-173f2047f1fe tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:22.299118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2d0c470-d2ff-4e6f-8917-173f2047f1fe tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:22.300303 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2d0c470-d2ff-4e6f-8917-173f2047f1fe tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:22.301023 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2d0c470-d2ff-4e6f-8917-173f2047f1fe tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:22.301928 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2d0c470-d2ff-4e6f-8917-173f2047f1fe tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:22.449518 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d2d0c470-d2ff-4e6f-8917-173f2047f1fe tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:22.457213 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d2d0c470-d2ff-4e6f-8917-173f2047f1fe tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1266 microversion: 2.1 time: 0.175805 Aug 22 05:50:22.458007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 469/947] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:22 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:50:23.488121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f102a0ae-e9f6-4089-82bc-6d4492c2b212 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:23.488815 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f102a0ae-e9f6-4089-82bc-6d4492c2b212 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:23.495973 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f102a0ae-e9f6-4089-82bc-6d4492c2b212 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:23.496458 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f102a0ae-e9f6-4089-82bc-6d4492c2b212 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:23.496888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f102a0ae-e9f6-4089-82bc-6d4492c2b212 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:23.497587 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f102a0ae-e9f6-4089-82bc-6d4492c2b212 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:23.498032 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f102a0ae-e9f6-4089-82bc-6d4492c2b212 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:23.498432 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f102a0ae-e9f6-4089-82bc-6d4492c2b212 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:23.639301 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-f102a0ae-e9f6-4089-82bc-6d4492c2b212 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:23.647756 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f102a0ae-e9f6-4089-82bc-6d4492c2b212 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1266 microversion: 2.1 time: 0.165536 Aug 22 05:50:23.648328 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 479/948] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:23 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:50:24.673276 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1987340d-3f67-4532-af23-e779f4b483fa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:24.674317 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1987340d-3f67-4532-af23-e779f4b483fa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:24.682974 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1987340d-3f67-4532-af23-e779f4b483fa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:24.683428 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1987340d-3f67-4532-af23-e779f4b483fa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:24.683921 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1987340d-3f67-4532-af23-e779f4b483fa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:24.684611 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1987340d-3f67-4532-af23-e779f4b483fa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:24.685059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1987340d-3f67-4532-af23-e779f4b483fa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:24.685503 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1987340d-3f67-4532-af23-e779f4b483fa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:24.834043 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1987340d-3f67-4532-af23-e779f4b483fa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:24.843522 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1987340d-3f67-4532-af23-e779f4b483fa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1266 microversion: 2.1 time: 0.176718 Aug 22 05:50:24.844128 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 470/949] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:24 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:50:25.869150 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-227f5e10-798d-4093-8761-c880fd3dc155 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:25.870084 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-227f5e10-798d-4093-8761-c880fd3dc155 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:25.881029 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-227f5e10-798d-4093-8761-c880fd3dc155 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:25.881939 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-227f5e10-798d-4093-8761-c880fd3dc155 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:25.882335 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-227f5e10-798d-4093-8761-c880fd3dc155 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:25.883030 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-227f5e10-798d-4093-8761-c880fd3dc155 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:25.883478 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-227f5e10-798d-4093-8761-c880fd3dc155 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:25.883923 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-227f5e10-798d-4093-8761-c880fd3dc155 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:26.036359 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-227f5e10-798d-4093-8761-c880fd3dc155 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:26.044906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-227f5e10-798d-4093-8761-c880fd3dc155 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1266 microversion: 2.1 time: 0.182557 Aug 22 05:50:26.045470 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 480/950] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:25 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:50:27.070068 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1876ff44-ffb4-459e-8ac0-35b6296ad4c6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:27.070795 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1876ff44-ffb4-459e-8ac0-35b6296ad4c6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:27.078261 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1876ff44-ffb4-459e-8ac0-35b6296ad4c6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:27.078795 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1876ff44-ffb4-459e-8ac0-35b6296ad4c6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:27.079273 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1876ff44-ffb4-459e-8ac0-35b6296ad4c6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:27.080073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1876ff44-ffb4-459e-8ac0-35b6296ad4c6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:27.080572 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1876ff44-ffb4-459e-8ac0-35b6296ad4c6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:27.081035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1876ff44-ffb4-459e-8ac0-35b6296ad4c6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:27.384425 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1876ff44-ffb4-459e-8ac0-35b6296ad4c6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:27.396440 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1876ff44-ffb4-459e-8ac0-35b6296ad4c6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1266 microversion: 2.1 time: 0.332512 Aug 22 05:50:27.397424 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 471/951] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:27 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1266 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:50:28.425355 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a179f126-b943-4092-9211-cecc4f2f28a1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:28.426315 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a179f126-b943-4092-9211-cecc4f2f28a1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:28.430079 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=2 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:28.435742 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a179f126-b943-4092-9211-cecc4f2f28a1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:28.436212 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a179f126-b943-4092-9211-cecc4f2f28a1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:28.436632 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a179f126-b943-4092-9211-cecc4f2f28a1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:28.437313 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a179f126-b943-4092-9211-cecc4f2f28a1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:28.437755 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a179f126-b943-4092-9211-cecc4f2f28a1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:28.438163 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a179f126-b943-4092-9211-cecc4f2f28a1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:28.584072 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a179f126-b943-4092-9211-cecc4f2f28a1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:28.596410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a179f126-b943-4092-9211-cecc4f2f28a1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1266 microversion: 2.1 time: 0.177291 Aug 22 05:50:28.597184 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 481/952] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:28 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:50:29.618263 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-44a8e61a-973a-4010-8ab7-ef3a48cd328b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:29.618835 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-44a8e61a-973a-4010-8ab7-ef3a48cd328b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:29.621768 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:29.622437 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=6 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:29.626927 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-44a8e61a-973a-4010-8ab7-ef3a48cd328b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:29.627413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-44a8e61a-973a-4010-8ab7-ef3a48cd328b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:29.627866 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-44a8e61a-973a-4010-8ab7-ef3a48cd328b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:29.628555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-44a8e61a-973a-4010-8ab7-ef3a48cd328b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:29.628987 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-44a8e61a-973a-4010-8ab7-ef3a48cd328b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:29.629391 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-44a8e61a-973a-4010-8ab7-ef3a48cd328b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:29.770432 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-44a8e61a-973a-4010-8ab7-ef3a48cd328b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:29.779375 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-44a8e61a-973a-4010-8ab7-ef3a48cd328b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1266 microversion: 2.1 time: 0.165367 Aug 22 05:50:29.780030 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 472/953] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:29 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:50:30.804806 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e76c9d06-62d7-4095-a8cd-2f2ddba77b91 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:30.805672 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e76c9d06-62d7-4095-a8cd-2f2ddba77b91 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:30.816723 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e76c9d06-62d7-4095-a8cd-2f2ddba77b91 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:30.817563 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e76c9d06-62d7-4095-a8cd-2f2ddba77b91 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:30.818296 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e76c9d06-62d7-4095-a8cd-2f2ddba77b91 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:30.819484 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e76c9d06-62d7-4095-a8cd-2f2ddba77b91 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:30.820283 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e76c9d06-62d7-4095-a8cd-2f2ddba77b91 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:30.821130 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e76c9d06-62d7-4095-a8cd-2f2ddba77b91 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:30.961630 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e76c9d06-62d7-4095-a8cd-2f2ddba77b91 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:30.970116 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e76c9d06-62d7-4095-a8cd-2f2ddba77b91 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1266 microversion: 2.1 time: 0.171978 Aug 22 05:50:30.970717 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 482/954] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:30 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:50:31.994513 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-90b4c294-c2ea-40c7-854a-9bfaa4f39ac1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:31.995211 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-90b4c294-c2ea-40c7-854a-9bfaa4f39ac1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:32.003789 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90b4c294-c2ea-40c7-854a-9bfaa4f39ac1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:32.004309 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90b4c294-c2ea-40c7-854a-9bfaa4f39ac1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:32.004804 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90b4c294-c2ea-40c7-854a-9bfaa4f39ac1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:32.005544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90b4c294-c2ea-40c7-854a-9bfaa4f39ac1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:32.006095 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90b4c294-c2ea-40c7-854a-9bfaa4f39ac1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:32.006555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-90b4c294-c2ea-40c7-854a-9bfaa4f39ac1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:32.151280 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-90b4c294-c2ea-40c7-854a-9bfaa4f39ac1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:32.159375 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-90b4c294-c2ea-40c7-854a-9bfaa4f39ac1 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1266 microversion: 2.1 time: 0.170784 Aug 22 05:50:32.159978 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 473/955] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:31 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:50:32.585336 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-387de55d-7b45-417b-9199-560ca074d356 req-fb939106-af1a-4567-bb4b-21fad0b86964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38dec1b-72b3-49d9-a7cc-aeb7883bae61", "name": "network-vif-plugged", "status": "completed", "tag": "47de31c9-e5de-48fc-bc8d-c30da7ad0fa4"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:50:32.596779 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-387de55d-7b45-417b-9199-560ca074d356 req-fb939106-af1a-4567-bb4b-21fad0b86964 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:32.597262 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-387de55d-7b45-417b-9199-560ca074d356 req-fb939106-af1a-4567-bb4b-21fad0b86964 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:32.597692 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-387de55d-7b45-417b-9199-560ca074d356 req-fb939106-af1a-4567-bb4b-21fad0b86964 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:32.609185 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-387de55d-7b45-417b-9199-560ca074d356 req-fb939106-af1a-4567-bb4b-21fad0b86964 service nova] Creating event network-vif-plugged:47de31c9-e5de-48fc-bc8d-c30da7ad0fa4 for instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 on hv-cinder-85391 Aug 22 05:50:32.614212 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-387de55d-7b45-417b-9199-560ca074d356 req-fb939106-af1a-4567-bb4b-21fad0b86964 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032695 Aug 22 05:50:32.614972 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 483/956] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:50:33.184413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-36811f4b-cbed-444b-82fb-ba6790c4ebf4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:33.185623 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-36811f4b-cbed-444b-82fb-ba6790c4ebf4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:33.197410 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36811f4b-cbed-444b-82fb-ba6790c4ebf4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:33.197899 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36811f4b-cbed-444b-82fb-ba6790c4ebf4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:33.198333 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36811f4b-cbed-444b-82fb-ba6790c4ebf4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:33.199060 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36811f4b-cbed-444b-82fb-ba6790c4ebf4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:33.199608 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36811f4b-cbed-444b-82fb-ba6790c4ebf4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:33.200062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36811f4b-cbed-444b-82fb-ba6790c4ebf4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:33.334682 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-36811f4b-cbed-444b-82fb-ba6790c4ebf4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:33.343593 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-36811f4b-cbed-444b-82fb-ba6790c4ebf4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1266 microversion: 2.1 time: 0.165860 Aug 22 05:50:33.344150 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 474/957] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:33 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:50:34.367626 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-32cecc7c-afbb-458d-b74a-b35405bec25f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:34.369085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-32cecc7c-afbb-458d-b74a-b35405bec25f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:34.375375 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32cecc7c-afbb-458d-b74a-b35405bec25f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:34.375890 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32cecc7c-afbb-458d-b74a-b35405bec25f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:34.376325 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32cecc7c-afbb-458d-b74a-b35405bec25f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:34.377026 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32cecc7c-afbb-458d-b74a-b35405bec25f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:34.377468 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32cecc7c-afbb-458d-b74a-b35405bec25f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:34.377885 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32cecc7c-afbb-458d-b74a-b35405bec25f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:34.529319 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-32cecc7c-afbb-458d-b74a-b35405bec25f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:34.540427 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-32cecc7c-afbb-458d-b74a-b35405bec25f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1266 microversion: 2.1 time: 0.178024 Aug 22 05:50:34.541092 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 484/958] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:34 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:50:35.566030 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e7f2d897-6bf7-4597-b1d4-2d9835769d9b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:35.566982 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e7f2d897-6bf7-4597-b1d4-2d9835769d9b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:35.575818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e7f2d897-6bf7-4597-b1d4-2d9835769d9b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:35.576303 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e7f2d897-6bf7-4597-b1d4-2d9835769d9b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:35.576787 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e7f2d897-6bf7-4597-b1d4-2d9835769d9b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:35.577476 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e7f2d897-6bf7-4597-b1d4-2d9835769d9b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:35.577899 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e7f2d897-6bf7-4597-b1d4-2d9835769d9b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:35.578357 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e7f2d897-6bf7-4597-b1d4-2d9835769d9b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:35.720663 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e7f2d897-6bf7-4597-b1d4-2d9835769d9b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:35.732642 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e7f2d897-6bf7-4597-b1d4-2d9835769d9b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1453 microversion: 2.1 time: 0.172826 Aug 22 05:50:35.733482 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 475/959] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:35 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:50:35.756748 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5cbaa996-dd4b-4beb-ae30-ebceb34d6f15 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:35.757359 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5cbaa996-dd4b-4beb-ae30-ebceb34d6f15 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:35.764456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5cbaa996-dd4b-4beb-ae30-ebceb34d6f15 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:35.764986 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5cbaa996-dd4b-4beb-ae30-ebceb34d6f15 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:35.765380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5cbaa996-dd4b-4beb-ae30-ebceb34d6f15 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:35.766063 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5cbaa996-dd4b-4beb-ae30-ebceb34d6f15 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:35.766509 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5cbaa996-dd4b-4beb-ae30-ebceb34d6f15 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:35.766925 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5cbaa996-dd4b-4beb-ae30-ebceb34d6f15 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:35.902559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5cbaa996-dd4b-4beb-ae30-ebceb34d6f15 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:35.910658 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5cbaa996-dd4b-4beb-ae30-ebceb34d6f15 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1453 microversion: 2.1 time: 0.157824 Aug 22 05:50:35.911343 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 485/960] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:35 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:50:37.668086 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-7e38da12-846b-401b-aaf3-643543f97246 req-2965baf1-acad-4d88-9ca9-810d417431d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c38dec1b-72b3-49d9-a7cc-aeb7883bae61", "tag": "47de31c9-e5de-48fc-bc8d-c30da7ad0fa4"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:50:37.678432 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7e38da12-846b-401b-aaf3-643543f97246 req-2965baf1-acad-4d88-9ca9-810d417431d9 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:37.678911 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7e38da12-846b-401b-aaf3-643543f97246 req-2965baf1-acad-4d88-9ca9-810d417431d9 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:37.679338 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7e38da12-846b-401b-aaf3-643543f97246 req-2965baf1-acad-4d88-9ca9-810d417431d9 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:37.690646 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-7e38da12-846b-401b-aaf3-643543f97246 req-2965baf1-acad-4d88-9ca9-810d417431d9 service nova] Creating event network-changed:47de31c9-e5de-48fc-bc8d-c30da7ad0fa4 for instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 on hv-cinder-85391 Aug 22 05:50:37.695772 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-7e38da12-846b-401b-aaf3-643543f97246 req-2965baf1-acad-4d88-9ca9-810d417431d9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031556 Aug 22 05:50:37.696861 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 476/961] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:50:59.233880 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0928dba8-3136-40a6-bcfc-893075cd53ea tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:59.234514 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0928dba8-3136-40a6-bcfc-893075cd53ea tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:59.236850 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=22 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:59.237502 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=50 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:59.243271 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0928dba8-3136-40a6-bcfc-893075cd53ea tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:59.243784 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0928dba8-3136-40a6-bcfc-893075cd53ea tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:59.244221 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0928dba8-3136-40a6-bcfc-893075cd53ea tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:59.244926 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0928dba8-3136-40a6-bcfc-893075cd53ea tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:59.245788 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0928dba8-3136-40a6-bcfc-893075cd53ea tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:59.245990 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0928dba8-3136-40a6-bcfc-893075cd53ea tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:59.271924 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0928dba8-3136-40a6-bcfc-893075cd53ea tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e/ips" status: 200 len: 150 microversion: 2.1 time: 0.042318 Aug 22 05:50:59.272494 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 486/962] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 22 05:50:59 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:50:59.281904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:59.282650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=54 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:59.286813 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a29672ce-4cf8-46d1-9381-a3d05e21a2e3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99d0a842-6256-4e89-9666-98b0cd2a30bc"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:50:59.289247 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a29672ce-4cf8-46d1-9381-a3d05e21a2e3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:59.296795 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a29672ce-4cf8-46d1-9381-a3d05e21a2e3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:59.297270 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a29672ce-4cf8-46d1-9381-a3d05e21a2e3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:59.297708 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a29672ce-4cf8-46d1-9381-a3d05e21a2e3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:59.298392 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a29672ce-4cf8-46d1-9381-a3d05e21a2e3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:59.298834 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a29672ce-4cf8-46d1-9381-a3d05e21a2e3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:59.299249 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a29672ce-4cf8-46d1-9381-a3d05e21a2e3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:59.382870 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-a29672ce-4cf8-46d1-9381-a3d05e21a2e3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] HTTP exception thrown: Invalid volume: volume 99d0a842-6256-4e89-9666-98b0cd2a30bc is already attached to instances: 3a8c0835-e37b-42f9-99f6-be6465184333 Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a29672ce-4cf8-46d1-9381-a3d05e21a2e3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Request method failure captured: Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: POST /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e/os-volume_attachments HTTP/1.1 Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 74 Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxiB0Gr4ALACYYqYuigC9S-TnfoLV67-YFQv-bpD8zW-bDZ5brcwg_NF6SPJrEY2yLZrbM8eHzVA5EEKj_L3SbP1PonBqgPsCBCGVlsGI0AQRHWXA0g7rqTVBIjxgNMSn_JGuq8vEJ6-qXLyAhNXmm9NFNkofHNPMmDB_TukKpKz6K8 Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:50:59.384649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:50:59.386797 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fae948b0baa04f2eb07b2aee2785dcdd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:50:59.386797 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:50:59.386797 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:50:59.386797 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:50:59.386797 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:50:59.386797 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:50:59.386797 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:50:59.386797 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: ed76a574d2fc4bd8a1f1176d0fef86e2 Aug 22 05:50:59.386797 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:50:59.386797 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Aug 22 05:50:59.386797 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {"volumeAttachment": {"volumeId": "99d0a842-6256-4e89-9666-98b0cd2a30bc"}} Aug 22 05:50:59.386797 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Invalid volume: volume 99d0a842-6256-4e89-9666-98b0cd2a30bc is already attached to instances: 3a8c0835-e37b-42f9-99f6-be6465184333 Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'server_id': '38c74c55-3079-4099-9b60-2146b6ad9e5e', 'body': {'volumeAttachment': {'volumeId': '99d0a842-6256-4e89-9666-98b0cd2a30bc'}}} Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 99d0a842-6256-4e89-9666-98b0cd2a30bc is already attached to instances: 3a8c0835-e37b-42f9-99f6-be6465184333 Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:50:59.387818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 99d0a842-6256-4e89-9666-98b0cd2a30bc is already attached to instances: 3a8c0835-e37b-42f9-99f6-be6465184333 Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:50:59.389352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:50:59.390974 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:50:59.390974 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:50:59.390974 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:50:59.390974 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 99d0a842-6256-4e89-9666-98b0cd2a30bc is already attached to instances: 3a8c0835-e37b-42f9-99f6-be6465184333 Aug 22 05:50:59.390974 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:50:59.390974 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a29672ce-4cf8-46d1-9381-a3d05e21a2e3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Returning 400 to user: Invalid volume: volume 99d0a842-6256-4e89-9666-98b0cd2a30bc is already attached to instances: 3a8c0835-e37b-42f9-99f6-be6465184333 {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:50:59.390974 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a29672ce-4cf8-46d1-9381-a3d05e21a2e3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "POST /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105824 Aug 22 05:50:59.390974 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 477/963] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 22 05:50:59 2022] POST /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 05:50:59.394879 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-033fd5e5-3da4-4612-9594-1ec379510fa2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:59.395399 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-033fd5e5-3da4-4612-9594-1ec379510fa2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:59.402570 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-033fd5e5-3da4-4612-9594-1ec379510fa2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:59.403050 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-033fd5e5-3da4-4612-9594-1ec379510fa2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:59.403496 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-033fd5e5-3da4-4612-9594-1ec379510fa2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:59.404195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-033fd5e5-3da4-4612-9594-1ec379510fa2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:59.404679 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-033fd5e5-3da4-4612-9594-1ec379510fa2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:59.405065 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-033fd5e5-3da4-4612-9594-1ec379510fa2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:59.430327 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-033fd5e5-3da4-4612-9594-1ec379510fa2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Going to try to terminate instance {{(pid=132497) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:50:59.510476 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-033fd5e5-3da4-4612-9594-1ec379510fa2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "DELETE /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 204 len: 0 microversion: 2.1 time: 0.119066 Aug 22 05:50:59.511376 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 487/964] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:50:59 2022] DELETE /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:50:59.520362 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2012b5d3-8782-4e3d-9b76-29295414c05b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:50:59.521030 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2012b5d3-8782-4e3d-9b76-29295414c05b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:50:59.527270 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2012b5d3-8782-4e3d-9b76-29295414c05b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:59.527826 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2012b5d3-8782-4e3d-9b76-29295414c05b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:59.528265 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2012b5d3-8782-4e3d-9b76-29295414c05b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:59.528963 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2012b5d3-8782-4e3d-9b76-29295414c05b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:50:59.529411 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2012b5d3-8782-4e3d-9b76-29295414c05b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:50:59.529828 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2012b5d3-8782-4e3d-9b76-29295414c05b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:50:59.667671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2012b5d3-8782-4e3d-9b76-29295414c05b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:50:59.679304 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2012b5d3-8782-4e3d-9b76-29295414c05b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 200 len: 1681 microversion: 2.1 time: 0.162554 Aug 22 05:50:59.680196 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 478/965] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:50:59 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:51:00.708994 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-89009844-4c38-40c2-a88e-07342ed21b2b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:00.709788 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-89009844-4c38-40c2-a88e-07342ed21b2b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:00.722643 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-89009844-4c38-40c2-a88e-07342ed21b2b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:00.725887 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-89009844-4c38-40c2-a88e-07342ed21b2b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:00.726504 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-89009844-4c38-40c2-a88e-07342ed21b2b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:00.727561 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-89009844-4c38-40c2-a88e-07342ed21b2b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:00.729804 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-89009844-4c38-40c2-a88e-07342ed21b2b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:00.730226 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-89009844-4c38-40c2-a88e-07342ed21b2b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:00.902708 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-89009844-4c38-40c2-a88e-07342ed21b2b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:51:00.914772 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-89009844-4c38-40c2-a88e-07342ed21b2b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 200 len: 1681 microversion: 2.1 time: 0.214003 Aug 22 05:51:00.915506 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 488/966] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:00 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:51:01.945484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3f7f87f1-ce55-4620-bec1-3753b7db0a4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:01.946122 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3f7f87f1-ce55-4620-bec1-3753b7db0a4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:01.957548 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f7f87f1-ce55-4620-bec1-3753b7db0a4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:01.958030 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f7f87f1-ce55-4620-bec1-3753b7db0a4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:01.958458 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f7f87f1-ce55-4620-bec1-3753b7db0a4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:01.959152 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f7f87f1-ce55-4620-bec1-3753b7db0a4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:01.959598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f7f87f1-ce55-4620-bec1-3753b7db0a4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:01.960028 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3f7f87f1-ce55-4620-bec1-3753b7db0a4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:02.024080 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-b2ee4378-29a0-4913-801d-c04d18d60743 req-96f8846b-2248-4243-abc9-53badc695b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c74c55-3079-4099-9b60-2146b6ad9e5e", "name": "network-vif-deleted", "tag": "f5fea5b6-7b00-4258-8337-940a7401a2bb"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:51:02.035277 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b2ee4378-29a0-4913-801d-c04d18d60743 req-96f8846b-2248-4243-abc9-53badc695b00 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:02.036061 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b2ee4378-29a0-4913-801d-c04d18d60743 req-96f8846b-2248-4243-abc9-53badc695b00 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:02.036659 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b2ee4378-29a0-4913-801d-c04d18d60743 req-96f8846b-2248-4243-abc9-53badc695b00 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:02.050567 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-b2ee4378-29a0-4913-801d-c04d18d60743 req-96f8846b-2248-4243-abc9-53badc695b00 service nova] Creating event network-vif-deleted:f5fea5b6-7b00-4258-8337-940a7401a2bb for instance 38c74c55-3079-4099-9b60-2146b6ad9e5e on hv-cinder-85391 Aug 22 05:51:02.056293 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3f7f87f1-ce55-4620-bec1-3753b7db0a4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:51:02.056852 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-b2ee4378-29a0-4913-801d-c04d18d60743 req-96f8846b-2248-4243-abc9-53badc695b00 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119682 Aug 22 05:51:02.065608 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3f7f87f1-ce55-4620-bec1-3753b7db0a4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 200 len: 1614 microversion: 2.1 time: 0.124845 Aug 22 05:51:02.066518 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 479/968] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:01 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 1614 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:51:02.066642 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 489/968] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:51:03.089877 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-92442791-8044-4605-a223-a448767141c2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:03.090578 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-92442791-8044-4605-a223-a448767141c2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:03.097101 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-92442791-8044-4605-a223-a448767141c2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:03.097675 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-92442791-8044-4605-a223-a448767141c2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:03.098107 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-92442791-8044-4605-a223-a448767141c2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:03.098788 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-92442791-8044-4605-a223-a448767141c2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:03.099257 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-92442791-8044-4605-a223-a448767141c2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:03.099721 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-92442791-8044-4605-a223-a448767141c2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:03.113439 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-92442791-8044-4605-a223-a448767141c2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] HTTP exception thrown: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-92442791-8044-4605-a223-a448767141c2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Request method failure captured: Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e HTTP/1.1 Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxiB0Gr4ALACYYqYuigC9S-TnfoLV67-YFQv-bpD8zW-bDZ5brcwg_NF6SPJrEY2yLZrbM8eHzVA5EEKj_L3SbP1PonBqgPsCBCGVlsGI0AQRHWXA0g7rqTVBIjxgNMSn_JGuq8vEJ6-qXLyAhNXmm9NFNkofHNPMmDB_TukKpKz6K8 Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:51:03.115098 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:51:03.116700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fae948b0baa04f2eb07b2aee2785dcdd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:51:03.116700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:51:03.116700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:51:03.116700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:51:03.116700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:51:03.116700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:51:03.116700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:51:03.116700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: ed76a574d2fc4bd8a1f1176d0fef86e2 Aug 22 05:51:03.116700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:51:03.116700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:51:03.116700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. Aug 22 05:51:03.116700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': '38c74c55-3079-4099-9b60-2146b6ad9e5e'} Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:51:03.117523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. Aug 22 05:51:03.118824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:51:03.120066 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-92442791-8044-4605-a223-a448767141c2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Returning 404 to user: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:51:03.120066 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-92442791-8044-4605-a223-a448767141c2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 404 len: 111 microversion: 2.1 time: 0.032010 Aug 22 05:51:03.120066 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 490/969] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:03 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:51:03.126119 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a753f2c8-0dc7-4198-8354-1c52a303f76a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '.version_select at 0x7f0b3de23af0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:03.147512 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a753f2c8-0dc7-4198-8354-1c52a303f76a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1115072321" status: 202 len: 0 microversion: 2.1 time: 0.025134 Aug 22 05:51:03.148621 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 480/970] 10.222.0.18 () {58 vars in 1221 bytes} [Mon Aug 22 05:51:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1115072321 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:51:03.834106 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-92731236-3a21-415f-b9c0-10ab4fb9695e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:03.834590 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-92731236-3a21-415f-b9c0-10ab4fb9695e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:03.842850 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-92731236-3a21-415f-b9c0-10ab4fb9695e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:03.843726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-92731236-3a21-415f-b9c0-10ab4fb9695e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:03.844509 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-92731236-3a21-415f-b9c0-10ab4fb9695e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:03.845652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-92731236-3a21-415f-b9c0-10ab4fb9695e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:03.846428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-92731236-3a21-415f-b9c0-10ab4fb9695e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:03.847131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-92731236-3a21-415f-b9c0-10ab4fb9695e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:03.937717 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.objects.instance [None req-92731236-3a21-415f-b9c0-10ab4fb9695e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lazy-loading 'services' on Instance uuid 3a8c0835-e37b-42f9-99f6-be6465184333 {{(pid=132497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:51:04.016173 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-92731236-3a21-415f-b9c0-10ab4fb9695e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333/os-volume_attachments/99d0a842-6256-4e89-9666-98b0cd2a30bc" status: 202 len: 0 microversion: 2.1 time: 0.186764 Aug 22 05:51:04.016821 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 491/971] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 22 05:51:03 2022] DELETE /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333/os-volume_attachments/99d0a842-6256-4e89-9666-98b0cd2a30bc => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:51:04.028044 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-951b2280-af40-4f0c-bb8c-6c20283d0c96 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:04.030260 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-951b2280-af40-4f0c-bb8c-6c20283d0c96 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:04.037579 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-951b2280-af40-4f0c-bb8c-6c20283d0c96 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:04.038134 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-951b2280-af40-4f0c-bb8c-6c20283d0c96 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:04.038579 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-951b2280-af40-4f0c-bb8c-6c20283d0c96 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:04.039277 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-951b2280-af40-4f0c-bb8c-6c20283d0c96 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:04.039753 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-951b2280-af40-4f0c-bb8c-6c20283d0c96 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:04.040172 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-951b2280-af40-4f0c-bb8c-6c20283d0c96 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:04.071378 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-951b2280-af40-4f0c-bb8c-6c20283d0c96 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048248 Aug 22 05:51:04.072432 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 481/972] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 22 05:51:04 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:51:05.090171 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f432de61-632d-426c-a066-44bfd2aceed2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:05.092654 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f432de61-632d-426c-a066-44bfd2aceed2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:05.099626 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f432de61-632d-426c-a066-44bfd2aceed2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:05.100134 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f432de61-632d-426c-a066-44bfd2aceed2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:05.100564 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f432de61-632d-426c-a066-44bfd2aceed2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:05.101281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f432de61-632d-426c-a066-44bfd2aceed2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:05.101727 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f432de61-632d-426c-a066-44bfd2aceed2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:05.102146 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f432de61-632d-426c-a066-44bfd2aceed2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:05.131690 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f432de61-632d-426c-a066-44bfd2aceed2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049154 Aug 22 05:51:05.132247 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 492/973] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 22 05:51:05 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 05:51:05.193867 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c4ef6067-339b-4f74-8fb8-1964c7f281ed tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:05.194395 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c4ef6067-339b-4f74-8fb8-1964c7f281ed tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:05.201379 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4ef6067-339b-4f74-8fb8-1964c7f281ed tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:05.201856 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4ef6067-339b-4f74-8fb8-1964c7f281ed tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:05.202285 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4ef6067-339b-4f74-8fb8-1964c7f281ed tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:05.202964 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4ef6067-339b-4f74-8fb8-1964c7f281ed tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:05.203406 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4ef6067-339b-4f74-8fb8-1964c7f281ed tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:05.203850 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c4ef6067-339b-4f74-8fb8-1964c7f281ed tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:05.228813 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c4ef6067-339b-4f74-8fb8-1964c7f281ed tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:51:05.312614 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c4ef6067-339b-4f74-8fb8-1964c7f281ed tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 204 len: 0 microversion: 2.1 time: 0.121824 Aug 22 05:51:05.313613 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 482/974] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:51:05 2022] DELETE /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:51:05.324245 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ed783009-ba63-4b15-8547-1c6613f570e4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:05.324971 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ed783009-ba63-4b15-8547-1c6613f570e4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:05.331505 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed783009-ba63-4b15-8547-1c6613f570e4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:05.332026 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed783009-ba63-4b15-8547-1c6613f570e4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:05.332459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed783009-ba63-4b15-8547-1c6613f570e4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:05.333159 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed783009-ba63-4b15-8547-1c6613f570e4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:05.333610 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed783009-ba63-4b15-8547-1c6613f570e4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:05.334031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed783009-ba63-4b15-8547-1c6613f570e4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:05.472652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ed783009-ba63-4b15-8547-1c6613f570e4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:51:05.480726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ed783009-ba63-4b15-8547-1c6613f570e4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1680 microversion: 2.1 time: 0.161685 Aug 22 05:51:05.481301 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 493/975] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:05 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:51:06.503433 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0f92aced-4e2f-4d76-a052-dd373832f2a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:06.504316 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0f92aced-4e2f-4d76-a052-dd373832f2a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:06.511859 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f92aced-4e2f-4d76-a052-dd373832f2a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:06.512710 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f92aced-4e2f-4d76-a052-dd373832f2a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:06.513134 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f92aced-4e2f-4d76-a052-dd373832f2a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:06.514548 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f92aced-4e2f-4d76-a052-dd373832f2a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:06.515235 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f92aced-4e2f-4d76-a052-dd373832f2a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:06.516024 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f92aced-4e2f-4d76-a052-dd373832f2a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:06.650515 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0f92aced-4e2f-4d76-a052-dd373832f2a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:51:06.658688 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0f92aced-4e2f-4d76-a052-dd373832f2a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1680 microversion: 2.1 time: 0.159600 Aug 22 05:51:06.659264 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 483/976] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:06 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:51:07.682946 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-94895869-699d-4e63-9b9d-a9e29a4ba499 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:07.683797 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-94895869-699d-4e63-9b9d-a9e29a4ba499 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:07.693500 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-94895869-699d-4e63-9b9d-a9e29a4ba499 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:07.693979 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-94895869-699d-4e63-9b9d-a9e29a4ba499 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:07.694403 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-94895869-699d-4e63-9b9d-a9e29a4ba499 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:07.695097 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-94895869-699d-4e63-9b9d-a9e29a4ba499 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:07.695536 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-94895869-699d-4e63-9b9d-a9e29a4ba499 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:07.695982 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-94895869-699d-4e63-9b9d-a9e29a4ba499 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:07.839459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-94895869-699d-4e63-9b9d-a9e29a4ba499 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:51:07.848108 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-94895869-699d-4e63-9b9d-a9e29a4ba499 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 200 len: 1680 microversion: 2.1 time: 0.169610 Aug 22 05:51:07.848747 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 494/977] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:07 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:51:08.084889 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-24bb65ba-8322-413f-9f8b-e9ab8b4eefbe req-1238e28c-1449-4438-8d23-6721b1b1f12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8c0835-e37b-42f9-99f6-be6465184333", "name": "network-vif-deleted", "tag": "4a9a90ee-356c-40e3-9a4f-7b08c4e6339d"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:51:08.096039 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-24bb65ba-8322-413f-9f8b-e9ab8b4eefbe req-1238e28c-1449-4438-8d23-6721b1b1f12e service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:08.096542 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-24bb65ba-8322-413f-9f8b-e9ab8b4eefbe req-1238e28c-1449-4438-8d23-6721b1b1f12e service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:08.096970 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-24bb65ba-8322-413f-9f8b-e9ab8b4eefbe req-1238e28c-1449-4438-8d23-6721b1b1f12e service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:08.110952 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-24bb65ba-8322-413f-9f8b-e9ab8b4eefbe req-1238e28c-1449-4438-8d23-6721b1b1f12e service nova] Creating event network-vif-deleted:4a9a90ee-356c-40e3-9a4f-7b08c4e6339d for instance 3a8c0835-e37b-42f9-99f6-be6465184333 on hv-cinder-85391 Aug 22 05:51:08.116364 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-24bb65ba-8322-413f-9f8b-e9ab8b4eefbe req-1238e28c-1449-4438-8d23-6721b1b1f12e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035195 Aug 22 05:51:08.117253 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 484/978] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:51:08.870310 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-eace1128-c1c1-430a-8cda-e67910f4c6d0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:08.870904 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-eace1128-c1c1-430a-8cda-e67910f4c6d0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:08.877965 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-eace1128-c1c1-430a-8cda-e67910f4c6d0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:08.878454 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-eace1128-c1c1-430a-8cda-e67910f4c6d0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:08.878862 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-eace1128-c1c1-430a-8cda-e67910f4c6d0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:08.879542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-eace1128-c1c1-430a-8cda-e67910f4c6d0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:08.880046 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-eace1128-c1c1-430a-8cda-e67910f4c6d0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:08.880543 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-eace1128-c1c1-430a-8cda-e67910f4c6d0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:08.895186 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-eace1128-c1c1-430a-8cda-e67910f4c6d0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] HTTP exception thrown: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-eace1128-c1c1-430a-8cda-e67910f4c6d0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Request method failure captured: Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 HTTP/1.1 Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxiB0Gr4ALACYYqYuigC9S-TnfoLV67-YFQv-bpD8zW-bDZ5brcwg_NF6SPJrEY2yLZrbM8eHzVA5EEKj_L3SbP1PonBqgPsCBCGVlsGI0AQRHWXA0g7rqTVBIjxgNMSn_JGuq8vEJ6-qXLyAhNXmm9NFNkofHNPMmDB_TukKpKz6K8 Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:51:08.896928 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:51:08.898436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fae948b0baa04f2eb07b2aee2785dcdd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:51:08.898436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:51:08.898436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:51:08.898436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:51:08.898436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:51:08.898436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:51:08.898436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:51:08.898436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: ed76a574d2fc4bd8a1f1176d0fef86e2 Aug 22 05:51:08.898436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:51:08.898436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:51:08.898436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. Aug 22 05:51:08.898436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': '3a8c0835-e37b-42f9-99f6-be6465184333'} Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:51:08.899462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. Aug 22 05:51:08.901218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:51:08.902581 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-eace1128-c1c1-430a-8cda-e67910f4c6d0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Returning 404 to user: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:51:08.902581 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-eace1128-c1c1-430a-8cda-e67910f4c6d0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 404 len: 111 microversion: 2.1 time: 0.032038 Aug 22 05:51:08.902581 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 495/979] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:08 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:51:08.908885 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ab05e8f1-a35c-494e-bb2d-b3c283716c9e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '.version_select at 0x7f0b3de78820>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:08.929898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ab05e8f1-a35c-494e-bb2d-b3c283716c9e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-705822394" status: 202 len: 0 microversion: 2.1 time: 0.026196 Aug 22 05:51:08.930486 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 485/980] 10.222.0.18 () {58 vars in 1218 bytes} [Mon Aug 22 05:51:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-705822394 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:51:09.595408 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-d4f34faa-6985-4207-8900-db091cf60568 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Action: 'create', calling method: .version_select at 0x7f0b3df20430>, body: {"keypair": {"name": "tempest-keypair-1784484649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFNvOtSwhUc5G1Bx4Dpl7rma1+M0RNM5XbL5g1tEu2byfCVtyIhc8BOkS5KMcG72DWwCKhzLZRq4BAYg2gXJww1g9DZizdI5KvXunnFFn3nZhA0bQridqv/HlX/9Rc6KA=="}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:51:09.611906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-d4f34faa-6985-4207-8900-db091cf60568 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Getting quotas for project fae948b0baa04f2eb07b2aee2785dcdd. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:51:09.615917 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-d4f34faa-6985-4207-8900-db091cf60568 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Getting quotas for user ed76a574d2fc4bd8a1f1176d0fef86e2 and project fae948b0baa04f2eb07b2aee2785dcdd. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:51:09.642428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-d4f34faa-6985-4207-8900-db091cf60568 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051441 Aug 22 05:51:09.643018 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 496/981] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 22 05:51:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:51:11.022895 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1829047175", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "01c51a10-ff3b-4b62-bd4e-eb6912d3a3c6"}], "security_groups": [{"name": "tempest-securitygroup--2071564172"}], "key_name": "tempest-keypair-1784484649", "user_data": "}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:51:11.143884 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] validate_networks() for [('01c51a10-ff3b-4b62-bd4e-eb6912d3a3c6', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:51:11.537288 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:51:11.537703 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:51:11.538161 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:51:11.538590 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:51:11.538991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:51:11.548449 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:11.548954 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:11.549377 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:11.550091 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:11.550524 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:11.550934 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:11.567753 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Getting quotas for project fae948b0baa04f2eb07b2aee2785dcdd. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:51:11.571917 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Getting quotas for user ed76a574d2fc4bd8a1f1176d0fef86e2 and project fae948b0baa04f2eb07b2aee2785dcdd. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:51:11.583557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:51:11.585966 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:51:11.644242 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8a07f692-8f2a-4c03-aed4-1431c568d76d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.629029 Aug 22 05:51:11.644850 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 486/982] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:51:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:51:11.656377 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7be21a6e-89c0-4b9b-8fc4-fc8ede08516a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:11.656998 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-7be21a6e-89c0-4b9b-8fc4-fc8ede08516a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:11.713621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-7be21a6e-89c0-4b9b-8fc4-fc8ede08516a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:51:11.721740 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-7be21a6e-89c0-4b9b-8fc4-fc8ede08516a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 200 len: 1242 microversion: 2.1 time: 0.069555 Aug 22 05:51:11.722337 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 497/983] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:11 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:51:12.743273 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d4e0563e-b5cd-48ae-b02b-d4a07c2e24a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:12.744283 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d4e0563e-b5cd-48ae-b02b-d4a07c2e24a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:12.752138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4e0563e-b5cd-48ae-b02b-d4a07c2e24a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:12.752619 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4e0563e-b5cd-48ae-b02b-d4a07c2e24a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:12.753164 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4e0563e-b5cd-48ae-b02b-d4a07c2e24a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:12.753852 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4e0563e-b5cd-48ae-b02b-d4a07c2e24a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:12.754327 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4e0563e-b5cd-48ae-b02b-d4a07c2e24a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:12.754742 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4e0563e-b5cd-48ae-b02b-d4a07c2e24a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:12.817379 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d4e0563e-b5cd-48ae-b02b-d4a07c2e24a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:51:12.825934 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d4e0563e-b5cd-48ae-b02b-d4a07c2e24a7 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 200 len: 1300 microversion: 2.1 time: 0.087542 Aug 22 05:51:12.826538 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 487/984] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:12 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:51:13.848247 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-3f9f4707-8701-461a-b6e2-e9c12b466e63 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:13.849055 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-3f9f4707-8701-461a-b6e2-e9c12b466e63 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:13.855294 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3f9f4707-8701-461a-b6e2-e9c12b466e63 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:13.855881 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3f9f4707-8701-461a-b6e2-e9c12b466e63 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:13.856361 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3f9f4707-8701-461a-b6e2-e9c12b466e63 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:13.857156 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3f9f4707-8701-461a-b6e2-e9c12b466e63 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:13.857661 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3f9f4707-8701-461a-b6e2-e9c12b466e63 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:13.858169 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3f9f4707-8701-461a-b6e2-e9c12b466e63 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:13.990944 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-e3979ef0-2543-4017-abe9-5f5a9bf3092e req-46e712cb-d1f0-4cbd-983d-4f0700a1b62e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a56118cf-1cde-4a07-be0e-7140d0138290", "tag": "621426da-bee2-4b04-ab70-6293416c8ad6"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:51:14.000294 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-3f9f4707-8701-461a-b6e2-e9c12b466e63 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:51:14.006940 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-e3979ef0-2543-4017-abe9-5f5a9bf3092e req-46e712cb-d1f0-4cbd-983d-4f0700a1b62e service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:14.007497 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-e3979ef0-2543-4017-abe9-5f5a9bf3092e req-46e712cb-d1f0-4cbd-983d-4f0700a1b62e service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:14.008203 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-e3979ef0-2543-4017-abe9-5f5a9bf3092e req-46e712cb-d1f0-4cbd-983d-4f0700a1b62e service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:14.011167 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-3f9f4707-8701-461a-b6e2-e9c12b466e63 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 200 len: 1368 microversion: 2.1 time: 0.166229 Aug 22 05:51:14.020264 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-e3979ef0-2543-4017-abe9-5f5a9bf3092e req-46e712cb-d1f0-4cbd-983d-4f0700a1b62e service nova] Creating event network-changed:621426da-bee2-4b04-ab70-6293416c8ad6 for instance a56118cf-1cde-4a07-be0e-7140d0138290 on hv-cinder-85391 Aug 22 05:51:14.025124 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 498/985] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:13 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:51:14.025345 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-e3979ef0-2543-4017-abe9-5f5a9bf3092e req-46e712cb-d1f0-4cbd-983d-4f0700a1b62e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038644 Aug 22 05:51:14.026001 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 488/986] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:51:15.037909 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-41f39921-5a40-44fd-9c6e-2a4fec82aac2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:15.038676 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-41f39921-5a40-44fd-9c6e-2a4fec82aac2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:15.050414 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-41f39921-5a40-44fd-9c6e-2a4fec82aac2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:15.051154 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-41f39921-5a40-44fd-9c6e-2a4fec82aac2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:15.051898 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-41f39921-5a40-44fd-9c6e-2a4fec82aac2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:15.052948 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-41f39921-5a40-44fd-9c6e-2a4fec82aac2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:15.053731 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-41f39921-5a40-44fd-9c6e-2a4fec82aac2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:15.054380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-41f39921-5a40-44fd-9c6e-2a4fec82aac2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:15.209013 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-41f39921-5a40-44fd-9c6e-2a4fec82aac2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:51:15.217600 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-41f39921-5a40-44fd-9c6e-2a4fec82aac2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 200 len: 1368 microversion: 2.1 time: 0.185960 Aug 22 05:51:15.218212 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 499/987] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:15 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:51:16.245185 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6eec851e-8d69-44cf-8e1f-7d6be8523944 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:16.246502 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6eec851e-8d69-44cf-8e1f-7d6be8523944 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:16.260280 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6eec851e-8d69-44cf-8e1f-7d6be8523944 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:16.261124 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6eec851e-8d69-44cf-8e1f-7d6be8523944 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:16.261838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6eec851e-8d69-44cf-8e1f-7d6be8523944 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:16.262973 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6eec851e-8d69-44cf-8e1f-7d6be8523944 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:16.263762 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6eec851e-8d69-44cf-8e1f-7d6be8523944 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:16.264459 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6eec851e-8d69-44cf-8e1f-7d6be8523944 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:16.400111 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6eec851e-8d69-44cf-8e1f-7d6be8523944 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:51:16.408510 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6eec851e-8d69-44cf-8e1f-7d6be8523944 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 200 len: 1368 microversion: 2.1 time: 0.171359 Aug 22 05:51:16.409098 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 489/988] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:16 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:51:17.430873 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c13680d0-59c5-4250-8015-3f3ca9c4d718 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:17.431684 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c13680d0-59c5-4250-8015-3f3ca9c4d718 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:17.439465 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c13680d0-59c5-4250-8015-3f3ca9c4d718 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:17.439988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c13680d0-59c5-4250-8015-3f3ca9c4d718 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:17.440419 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c13680d0-59c5-4250-8015-3f3ca9c4d718 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:17.441104 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c13680d0-59c5-4250-8015-3f3ca9c4d718 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:17.441554 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c13680d0-59c5-4250-8015-3f3ca9c4d718 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:17.441971 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c13680d0-59c5-4250-8015-3f3ca9c4d718 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:17.579611 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c13680d0-59c5-4250-8015-3f3ca9c4d718 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:51:17.587420 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c13680d0-59c5-4250-8015-3f3ca9c4d718 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 200 len: 1368 microversion: 2.1 time: 0.161608 Aug 22 05:51:17.587991 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 500/989] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:17 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:51:18.612290 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-34942166-4b3c-49d3-aa74-7254d0648291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:18.613172 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-34942166-4b3c-49d3-aa74-7254d0648291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:18.624332 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34942166-4b3c-49d3-aa74-7254d0648291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:18.624819 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34942166-4b3c-49d3-aa74-7254d0648291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:18.625249 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34942166-4b3c-49d3-aa74-7254d0648291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:18.625952 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34942166-4b3c-49d3-aa74-7254d0648291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:18.626391 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34942166-4b3c-49d3-aa74-7254d0648291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:18.626838 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34942166-4b3c-49d3-aa74-7254d0648291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:18.757488 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-34942166-4b3c-49d3-aa74-7254d0648291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:51:18.766247 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-34942166-4b3c-49d3-aa74-7254d0648291 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 200 len: 1368 microversion: 2.1 time: 0.160640 Aug 22 05:51:18.766824 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 490/990] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:18 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:51:19.791241 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8e4a59e2-7c16-438f-98ee-853163496b94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:19.792370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8e4a59e2-7c16-438f-98ee-853163496b94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:19.800739 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e4a59e2-7c16-438f-98ee-853163496b94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:19.801215 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e4a59e2-7c16-438f-98ee-853163496b94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:19.801638 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e4a59e2-7c16-438f-98ee-853163496b94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:19.802335 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e4a59e2-7c16-438f-98ee-853163496b94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:19.802778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e4a59e2-7c16-438f-98ee-853163496b94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:19.803193 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e4a59e2-7c16-438f-98ee-853163496b94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:19.946214 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8e4a59e2-7c16-438f-98ee-853163496b94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:51:19.954844 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8e4a59e2-7c16-438f-98ee-853163496b94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 200 len: 1368 microversion: 2.1 time: 0.170073 Aug 22 05:51:19.955415 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 501/991] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:19 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:51:20.833719 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-d6c9b492-f43d-4610-9b34-fe4dd58ec393 req-d4188b42-9ada-443a-8e22-4c8695085035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56118cf-1cde-4a07-be0e-7140d0138290", "name": "network-vif-plugged", "status": "completed", "tag": "621426da-bee2-4b04-ab70-6293416c8ad6"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:51:20.845576 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-d6c9b492-f43d-4610-9b34-fe4dd58ec393 req-d4188b42-9ada-443a-8e22-4c8695085035 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:20.846163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-d6c9b492-f43d-4610-9b34-fe4dd58ec393 req-d4188b42-9ada-443a-8e22-4c8695085035 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:20.846591 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-d6c9b492-f43d-4610-9b34-fe4dd58ec393 req-d4188b42-9ada-443a-8e22-4c8695085035 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:20.858059 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-d6c9b492-f43d-4610-9b34-fe4dd58ec393 req-d4188b42-9ada-443a-8e22-4c8695085035 service nova] Creating event network-vif-plugged:621426da-bee2-4b04-ab70-6293416c8ad6 for instance a56118cf-1cde-4a07-be0e-7140d0138290 on hv-cinder-85391 Aug 22 05:51:20.863133 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-d6c9b492-f43d-4610-9b34-fe4dd58ec393 req-d4188b42-9ada-443a-8e22-4c8695085035 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033190 Aug 22 05:51:20.863762 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 491/992] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:51:20.975698 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-566a778e-b830-42c9-ac19-4a523879dd6e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:20.976301 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-566a778e-b830-42c9-ac19-4a523879dd6e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:20.982742 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-566a778e-b830-42c9-ac19-4a523879dd6e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:20.983220 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-566a778e-b830-42c9-ac19-4a523879dd6e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:20.984138 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-566a778e-b830-42c9-ac19-4a523879dd6e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:20.984912 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-566a778e-b830-42c9-ac19-4a523879dd6e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:20.985362 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-566a778e-b830-42c9-ac19-4a523879dd6e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:20.985974 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-566a778e-b830-42c9-ac19-4a523879dd6e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:21.118034 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-566a778e-b830-42c9-ac19-4a523879dd6e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:51:21.128047 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-566a778e-b830-42c9-ac19-4a523879dd6e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 200 len: 1368 microversion: 2.1 time: 0.156201 Aug 22 05:51:21.128615 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 502/993] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:20 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:51:22.148952 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:22.150171 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=6 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:22.157408 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8f9480db-5e62-4c67-a52c-5d0b90e859d6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:22.158577 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8f9480db-5e62-4c67-a52c-5d0b90e859d6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:22.170127 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f9480db-5e62-4c67-a52c-5d0b90e859d6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:22.171072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f9480db-5e62-4c67-a52c-5d0b90e859d6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:22.172091 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f9480db-5e62-4c67-a52c-5d0b90e859d6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:22.172785 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f9480db-5e62-4c67-a52c-5d0b90e859d6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:22.173207 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f9480db-5e62-4c67-a52c-5d0b90e859d6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:22.173670 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f9480db-5e62-4c67-a52c-5d0b90e859d6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:22.322845 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8f9480db-5e62-4c67-a52c-5d0b90e859d6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:51:22.334570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8f9480db-5e62-4c67-a52c-5d0b90e859d6 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 200 len: 1368 microversion: 2.1 time: 0.187122 Aug 22 05:51:22.335514 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 492/994] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:22 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:51:23.358313 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-162fc081-5554-4395-8762-a3f4a560fe77 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:23.359434 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-162fc081-5554-4395-8762-a3f4a560fe77 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:23.362430 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=6 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:23.370267 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-162fc081-5554-4395-8762-a3f4a560fe77 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:23.370899 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-162fc081-5554-4395-8762-a3f4a560fe77 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:23.371466 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-162fc081-5554-4395-8762-a3f4a560fe77 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:23.372404 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-162fc081-5554-4395-8762-a3f4a560fe77 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:23.373007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-162fc081-5554-4395-8762-a3f4a560fe77 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:23.373546 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-162fc081-5554-4395-8762-a3f4a560fe77 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:23.513953 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-162fc081-5554-4395-8762-a3f4a560fe77 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:51:23.522050 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-162fc081-5554-4395-8762-a3f4a560fe77 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 200 len: 1557 microversion: 2.1 time: 0.169006 Aug 22 05:51:23.522624 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 503/995] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:51:23 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:51:23.542560 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bc167155-8f9a-4d40-87b5-168331d7a648 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:51:23.543089 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-bc167155-8f9a-4d40-87b5-168331d7a648 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:51:23.549721 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bc167155-8f9a-4d40-87b5-168331d7a648 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:23.550207 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bc167155-8f9a-4d40-87b5-168331d7a648 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:23.550639 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bc167155-8f9a-4d40-87b5-168331d7a648 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:23.551327 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bc167155-8f9a-4d40-87b5-168331d7a648 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:23.551837 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bc167155-8f9a-4d40-87b5-168331d7a648 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:23.552258 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bc167155-8f9a-4d40-87b5-168331d7a648 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:23.639984 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-bc167155-8f9a-4d40-87b5-168331d7a648 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101279 Aug 22 05:51:23.640559 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 493/996] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Aug 22 05:51:23 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:51:24.887442 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-2626e674-f4ef-4676-afdb-bdf4a56c2f66 req-70c279f4-97d1-4d84-9334-da2d0e8b813a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a56118cf-1cde-4a07-be0e-7140d0138290", "tag": "621426da-bee2-4b04-ab70-6293416c8ad6"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:51:24.897974 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-2626e674-f4ef-4676-afdb-bdf4a56c2f66 req-70c279f4-97d1-4d84-9334-da2d0e8b813a service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:51:24.898452 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-2626e674-f4ef-4676-afdb-bdf4a56c2f66 req-70c279f4-97d1-4d84-9334-da2d0e8b813a service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:51:24.898883 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-2626e674-f4ef-4676-afdb-bdf4a56c2f66 req-70c279f4-97d1-4d84-9334-da2d0e8b813a service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:51:24.911107 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-2626e674-f4ef-4676-afdb-bdf4a56c2f66 req-70c279f4-97d1-4d84-9334-da2d0e8b813a service nova] Creating event network-changed:621426da-bee2-4b04-ab70-6293416c8ad6 for instance a56118cf-1cde-4a07-be0e-7140d0138290 on hv-cinder-85391 Aug 22 05:51:24.916205 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-2626e674-f4ef-4676-afdb-bdf4a56c2f66 req-70c279f4-97d1-4d84-9334-da2d0e8b813a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032447 Aug 22 05:51:24.916814 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 504/997] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:52:29.490848 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:29.491625 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:29.496509 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-253fe9c5-b7f0-4be1-ad35-e377512f945c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:29.497013 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-253fe9c5-b7f0-4be1-ad35-e377512f945c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:29.504628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-253fe9c5-b7f0-4be1-ad35-e377512f945c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:29.505113 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-253fe9c5-b7f0-4be1-ad35-e377512f945c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:29.505544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-253fe9c5-b7f0-4be1-ad35-e377512f945c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:29.506230 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-253fe9c5-b7f0-4be1-ad35-e377512f945c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:29.506673 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-253fe9c5-b7f0-4be1-ad35-e377512f945c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:29.507088 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-253fe9c5-b7f0-4be1-ad35-e377512f945c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:29.533170 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-253fe9c5-b7f0-4be1-ad35-e377512f945c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290/ips" status: 200 len: 147 microversion: 2.1 time: 0.044387 Aug 22 05:52:29.536530 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 494/998] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 22 05:52:29 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290/ips => generated 147 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:52:30.896929 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:30.897678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:30.903472 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-06b81298-cf17-4d9c-8fdd-8c06aba2ee0f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "595d5950-bf13-45b9-8bbf-d831c35ca03b"}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:52:30.905918 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-06b81298-cf17-4d9c-8fdd-8c06aba2ee0f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:30.915561 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06b81298-cf17-4d9c-8fdd-8c06aba2ee0f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:30.916068 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06b81298-cf17-4d9c-8fdd-8c06aba2ee0f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:30.916518 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06b81298-cf17-4d9c-8fdd-8c06aba2ee0f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:30.917212 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06b81298-cf17-4d9c-8fdd-8c06aba2ee0f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:30.917684 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06b81298-cf17-4d9c-8fdd-8c06aba2ee0f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:30.918105 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-06b81298-cf17-4d9c-8fdd-8c06aba2ee0f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:31.183709 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-06b81298-cf17-4d9c-8fdd-8c06aba2ee0f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "POST /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288903 Aug 22 05:52:31.184307 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 505/999] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 22 05:52:30 2022] POST /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:52:38.779862 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fc2f2335-85df-4829-ac03-51c533d26428 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "595d5950-bf13-45b9-8bbf-d831c35ca03b"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:52:38.782564 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fc2f2335-85df-4829-ac03-51c533d26428 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:38.789543 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc2f2335-85df-4829-ac03-51c533d26428 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:38.790018 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc2f2335-85df-4829-ac03-51c533d26428 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:38.790448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc2f2335-85df-4829-ac03-51c533d26428 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:38.791131 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc2f2335-85df-4829-ac03-51c533d26428 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:38.791609 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc2f2335-85df-4829-ac03-51c533d26428 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:38.792035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc2f2335-85df-4829-ac03-51c533d26428 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:38.875237 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-fc2f2335-85df-4829-ac03-51c533d26428 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] HTTP exception thrown: Invalid volume: volume 595d5950-bf13-45b9-8bbf-d831c35ca03b is already attached to instances: a56118cf-1cde-4a07-be0e-7140d0138290 Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fc2f2335-85df-4829-ac03-51c533d26428 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Request method failure captured: Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: POST /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290/os-volume_attachments HTTP/1.1 Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 74 Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxiB0Gr4ALACYYqYuigC9S-TnfoLV67-YFQv-bpD8zW-bDZ5brcwg_NF6SPJrEY2yLZrbM8eHzVA5EEKj_L3SbP1PonBqgPsCBCGVlsGI0AQRHWXA0g7rqTVBIjxgNMSn_JGuq8vEJ6-qXLyAhNXmm9NFNkofHNPMmDB_TukKpKz6K8 Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:52:38.877079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:52:38.878566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fae948b0baa04f2eb07b2aee2785dcdd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:52:38.878566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:52:38.878566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:52:38.878566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:52:38.878566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:52:38.878566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:52:38.878566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:52:38.878566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: ed76a574d2fc4bd8a1f1176d0fef86e2 Aug 22 05:52:38.878566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:52:38.878566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Aug 22 05:52:38.878566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {"volumeAttachment": {"volumeId": "595d5950-bf13-45b9-8bbf-d831c35ca03b"}} Aug 22 05:52:38.878566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Invalid volume: volume 595d5950-bf13-45b9-8bbf-d831c35ca03b is already attached to instances: a56118cf-1cde-4a07-be0e-7140d0138290 Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'server_id': 'a56118cf-1cde-4a07-be0e-7140d0138290', 'body': {'volumeAttachment': {'volumeId': '595d5950-bf13-45b9-8bbf-d831c35ca03b'}}} Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 595d5950-bf13-45b9-8bbf-d831c35ca03b is already attached to instances: a56118cf-1cde-4a07-be0e-7140d0138290 Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:52:38.879368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 595d5950-bf13-45b9-8bbf-d831c35ca03b is already attached to instances: a56118cf-1cde-4a07-be0e-7140d0138290 Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:52:38.880806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:52:38.882413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:52:38.882413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:52:38.882413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:52:38.882413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 595d5950-bf13-45b9-8bbf-d831c35ca03b is already attached to instances: a56118cf-1cde-4a07-be0e-7140d0138290 Aug 22 05:52:38.882413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:52:38.882413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fc2f2335-85df-4829-ac03-51c533d26428 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Returning 400 to user: Invalid volume: volume 595d5950-bf13-45b9-8bbf-d831c35ca03b is already attached to instances: a56118cf-1cde-4a07-be0e-7140d0138290 {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:52:38.882413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fc2f2335-85df-4829-ac03-51c533d26428 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "POST /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105744 Aug 22 05:52:38.882413 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 495/1000] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 22 05:52:38 2022] POST /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 05:52:38.947592 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-36741d81-fcf1-41c6-9d32-2f7945d0bb4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:38.948220 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-36741d81-fcf1-41c6-9d32-2f7945d0bb4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:38.954964 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-36741d81-fcf1-41c6-9d32-2f7945d0bb4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:38.955441 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-36741d81-fcf1-41c6-9d32-2f7945d0bb4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:38.955902 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-36741d81-fcf1-41c6-9d32-2f7945d0bb4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:38.956581 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-36741d81-fcf1-41c6-9d32-2f7945d0bb4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:38.957043 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-36741d81-fcf1-41c6-9d32-2f7945d0bb4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:38.957452 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-36741d81-fcf1-41c6-9d32-2f7945d0bb4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:39.052707 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.objects.instance [None req-36741d81-fcf1-41c6-9d32-2f7945d0bb4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lazy-loading 'services' on Instance uuid a56118cf-1cde-4a07-be0e-7140d0138290 {{(pid=132497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:52:39.139720 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-36741d81-fcf1-41c6-9d32-2f7945d0bb4c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290/os-volume_attachments/595d5950-bf13-45b9-8bbf-d831c35ca03b" status: 202 len: 0 microversion: 2.1 time: 0.196799 Aug 22 05:52:39.140308 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 506/1001] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 22 05:52:38 2022] DELETE /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290/os-volume_attachments/595d5950-bf13-45b9-8bbf-d831c35ca03b => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:52:39.149041 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d5de79a9-9d34-4c7f-9c8d-b8dc06fb004f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:39.151478 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d5de79a9-9d34-4c7f-9c8d-b8dc06fb004f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:39.157593 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d5de79a9-9d34-4c7f-9c8d-b8dc06fb004f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:39.158070 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d5de79a9-9d34-4c7f-9c8d-b8dc06fb004f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:39.158859 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d5de79a9-9d34-4c7f-9c8d-b8dc06fb004f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:39.159607 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d5de79a9-9d34-4c7f-9c8d-b8dc06fb004f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:39.160324 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d5de79a9-9d34-4c7f-9c8d-b8dc06fb004f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:39.160743 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d5de79a9-9d34-4c7f-9c8d-b8dc06fb004f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:39.192296 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d5de79a9-9d34-4c7f-9c8d-b8dc06fb004f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047427 Aug 22 05:52:39.192907 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 496/1002] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 22 05:52:39 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:52:40.210786 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-1925b6ef-803d-473c-b9e8-fdaec6ed1fb3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:40.214959 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-1925b6ef-803d-473c-b9e8-fdaec6ed1fb3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:40.222416 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1925b6ef-803d-473c-b9e8-fdaec6ed1fb3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:40.222890 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1925b6ef-803d-473c-b9e8-fdaec6ed1fb3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:40.223311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1925b6ef-803d-473c-b9e8-fdaec6ed1fb3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:40.224029 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1925b6ef-803d-473c-b9e8-fdaec6ed1fb3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:40.224469 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1925b6ef-803d-473c-b9e8-fdaec6ed1fb3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:40.224879 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1925b6ef-803d-473c-b9e8-fdaec6ed1fb3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:40.254368 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-1925b6ef-803d-473c-b9e8-fdaec6ed1fb3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051550 Aug 22 05:52:40.254912 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 507/1003] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 22 05:52:40 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 05:52:40.325887 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-105e1a69-a2cd-4184-bece-63bef0e86932 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:40.326787 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-105e1a69-a2cd-4184-bece-63bef0e86932 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:40.333541 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-105e1a69-a2cd-4184-bece-63bef0e86932 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:40.334020 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-105e1a69-a2cd-4184-bece-63bef0e86932 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:40.334451 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-105e1a69-a2cd-4184-bece-63bef0e86932 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:40.335137 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-105e1a69-a2cd-4184-bece-63bef0e86932 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:40.335602 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-105e1a69-a2cd-4184-bece-63bef0e86932 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:40.336113 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-105e1a69-a2cd-4184-bece-63bef0e86932 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:40.362227 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-105e1a69-a2cd-4184-bece-63bef0e86932 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:52:40.442294 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-105e1a69-a2cd-4184-bece-63bef0e86932 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 204 len: 0 microversion: 2.1 time: 0.120210 Aug 22 05:52:40.443017 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 497/1004] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:52:40 2022] DELETE /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:52:40.453498 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a50e015f-f446-4d31-ab56-f256d36c24ae tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:40.454111 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a50e015f-f446-4d31-ab56-f256d36c24ae tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:40.460252 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a50e015f-f446-4d31-ab56-f256d36c24ae tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:40.460734 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a50e015f-f446-4d31-ab56-f256d36c24ae tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:40.461220 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a50e015f-f446-4d31-ab56-f256d36c24ae tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:40.461855 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a50e015f-f446-4d31-ab56-f256d36c24ae tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:40.462300 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a50e015f-f446-4d31-ab56-f256d36c24ae tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:40.462721 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a50e015f-f446-4d31-ab56-f256d36c24ae tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:40.608331 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a50e015f-f446-4d31-ab56-f256d36c24ae tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:40.619477 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a50e015f-f446-4d31-ab56-f256d36c24ae tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 200 len: 1680 microversion: 2.1 time: 0.170664 Aug 22 05:52:40.620298 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 508/1005] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:40 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:41.652485 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d65a72db-00a6-4275-a390-ceecd0b7f6d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:41.654006 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d65a72db-00a6-4275-a390-ceecd0b7f6d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:41.662411 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d65a72db-00a6-4275-a390-ceecd0b7f6d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:41.662896 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d65a72db-00a6-4275-a390-ceecd0b7f6d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:41.663324 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d65a72db-00a6-4275-a390-ceecd0b7f6d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:41.664737 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d65a72db-00a6-4275-a390-ceecd0b7f6d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:41.665275 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d65a72db-00a6-4275-a390-ceecd0b7f6d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:41.665962 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d65a72db-00a6-4275-a390-ceecd0b7f6d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:41.803456 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d65a72db-00a6-4275-a390-ceecd0b7f6d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:41.814832 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d65a72db-00a6-4275-a390-ceecd0b7f6d4 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 200 len: 1680 microversion: 2.1 time: 0.169211 Aug 22 05:52:41.815548 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 498/1006] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:41 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:42.844100 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4b603b97-037c-423d-840e-d41c65d8ba62 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:42.844845 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-4b603b97-037c-423d-840e-d41c65d8ba62 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:42.851916 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4b603b97-037c-423d-840e-d41c65d8ba62 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:42.852406 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4b603b97-037c-423d-840e-d41c65d8ba62 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:42.852853 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4b603b97-037c-423d-840e-d41c65d8ba62 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:42.853547 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4b603b97-037c-423d-840e-d41c65d8ba62 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:42.853988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4b603b97-037c-423d-840e-d41c65d8ba62 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:42.854407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-4b603b97-037c-423d-840e-d41c65d8ba62 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:42.918152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-4b603b97-037c-423d-840e-d41c65d8ba62 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:42.929590 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4b603b97-037c-423d-840e-d41c65d8ba62 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 200 len: 1612 microversion: 2.1 time: 0.089092 Aug 22 05:52:42.930477 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 509/1007] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:42 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 1612 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:43.109894 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-3d8cc7b9-a6b7-4211-b2ed-ef1274c4cb3c req-257807bb-2790-4824-8bda-b8aca2d7a124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56118cf-1cde-4a07-be0e-7140d0138290", "name": "network-vif-deleted", "tag": "621426da-bee2-4b04-ab70-6293416c8ad6"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:52:43.120073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-3d8cc7b9-a6b7-4211-b2ed-ef1274c4cb3c req-257807bb-2790-4824-8bda-b8aca2d7a124 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:43.120552 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-3d8cc7b9-a6b7-4211-b2ed-ef1274c4cb3c req-257807bb-2790-4824-8bda-b8aca2d7a124 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:43.121514 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-3d8cc7b9-a6b7-4211-b2ed-ef1274c4cb3c req-257807bb-2790-4824-8bda-b8aca2d7a124 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:43.133209 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-3d8cc7b9-a6b7-4211-b2ed-ef1274c4cb3c req-257807bb-2790-4824-8bda-b8aca2d7a124 service nova] Creating event network-vif-deleted:621426da-bee2-4b04-ab70-6293416c8ad6 for instance a56118cf-1cde-4a07-be0e-7140d0138290 on hv-cinder-85391 Aug 22 05:52:43.138801 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-3d8cc7b9-a6b7-4211-b2ed-ef1274c4cb3c req-257807bb-2790-4824-8bda-b8aca2d7a124 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032650 Aug 22 05:52:43.143206 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 499/1008] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:52:43.953520 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-26ea6f58-528d-4e88-b4d9-6be5b4cbea6d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:43.954217 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-26ea6f58-528d-4e88-b4d9-6be5b4cbea6d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:43.961603 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26ea6f58-528d-4e88-b4d9-6be5b4cbea6d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:43.962094 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26ea6f58-528d-4e88-b4d9-6be5b4cbea6d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:43.962542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26ea6f58-528d-4e88-b4d9-6be5b4cbea6d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:43.963236 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26ea6f58-528d-4e88-b4d9-6be5b4cbea6d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:43.963806 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26ea6f58-528d-4e88-b4d9-6be5b4cbea6d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:43.964609 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-26ea6f58-528d-4e88-b4d9-6be5b4cbea6d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:43.979355 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-26ea6f58-528d-4e88-b4d9-6be5b4cbea6d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] HTTP exception thrown: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-26ea6f58-528d-4e88-b4d9-6be5b4cbea6d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Request method failure captured: Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 HTTP/1.1 Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxiB0Gr4ALACYYqYuigC9S-TnfoLV67-YFQv-bpD8zW-bDZ5brcwg_NF6SPJrEY2yLZrbM8eHzVA5EEKj_L3SbP1PonBqgPsCBCGVlsGI0AQRHWXA0g7rqTVBIjxgNMSn_JGuq8vEJ6-qXLyAhNXmm9NFNkofHNPMmDB_TukKpKz6K8 Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:52:43.980706 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:52:43.982497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fae948b0baa04f2eb07b2aee2785dcdd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:52:43.982497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:52:43.982497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:52:43.982497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:52:43.982497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:52:43.982497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:52:43.982497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:52:43.982497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: ed76a574d2fc4bd8a1f1176d0fef86e2 Aug 22 05:52:43.982497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:52:43.982497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:52:43.982497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. Aug 22 05:52:43.982497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': 'a56118cf-1cde-4a07-be0e-7140d0138290'} Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:52:43.986608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. Aug 22 05:52:43.988182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:52:43.989592 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-26ea6f58-528d-4e88-b4d9-6be5b4cbea6d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Returning 404 to user: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:52:43.989592 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-26ea6f58-528d-4e88-b4d9-6be5b4cbea6d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 404 len: 111 microversion: 2.1 time: 0.033037 Aug 22 05:52:43.989592 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 510/1009] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:43 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:52:43.991822 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3bba84c9-6762-4cc9-b0ca-8a1623c48859 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '.version_select at 0x7f0b3dedbdc0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:44.010551 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3bba84c9-6762-4cc9-b0ca-8a1623c48859 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784484649" status: 202 len: 0 microversion: 2.1 time: 0.022827 Aug 22 05:52:44.011114 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 500/1010] 10.222.0.18 () {58 vars in 1221 bytes} [Mon Aug 22 05:52:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784484649 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 05:52:44.664568 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0b939016-2ec9-47fb-9771-c8ce864fe57d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Action: 'create', calling method: .version_select at 0x7f0b3defcdc0>, body: {"keypair": {"name": "tempest-keypair-201567347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxgPDLK5F4+irypRtqJ1/aHwbIrDvORqF0k4wSRPkHl285RYO1qIaDD5q2moja7+qnBrYzePv7t34a55u87vvU1iJuB9i8Kbj141LDoZZdqaajaCuUuh7nFqFTGcSNUZQ=="}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:52:44.687608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-0b939016-2ec9-47fb-9771-c8ce864fe57d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Getting quotas for project fae948b0baa04f2eb07b2aee2785dcdd. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:52:44.691845 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-0b939016-2ec9-47fb-9771-c8ce864fe57d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Getting quotas for user ed76a574d2fc4bd8a1f1176d0fef86e2 and project fae948b0baa04f2eb07b2aee2785dcdd. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:52:44.720131 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0b939016-2ec9-47fb-9771-c8ce864fe57d tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062289 Aug 22 05:52:44.720721 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 511/1011] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 22 05:52:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:52:46.069802 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2120851216", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "01c51a10-ff3b-4b62-bd4e-eb6912d3a3c6"}], "security_groups": [{"name": "tempest-securitygroup--1020275986"}], "key_name": "tempest-keypair-201567347", "user_data": "}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:52:46.176466 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] validate_networks() for [('01c51a10-ff3b-4b62-bd4e-eb6912d3a3c6', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:52:46.564622 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:52:46.565040 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:52:46.565513 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:52:46.565914 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:52:46.566317 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:52:46.576114 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:46.576593 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:46.577024 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:46.577747 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:46.578194 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:46.578619 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:46.598932 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Getting quotas for project fae948b0baa04f2eb07b2aee2785dcdd. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:52:46.603038 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Getting quotas for user ed76a574d2fc4bd8a1f1176d0fef86e2 and project fae948b0baa04f2eb07b2aee2785dcdd. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:52:46.619277 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:52:46.621995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:52:46.671804 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7bc6f736-a977-4963-b5f3-8701bccbd56f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.606720 Aug 22 05:52:46.672552 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 501/1012] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:52:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:52:46.684167 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-88bddd59-364f-40cb-b5bf-9ce16f39ea82 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:46.684879 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-88bddd59-364f-40cb-b5bf-9ce16f39ea82 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:46.740725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-88bddd59-364f-40cb-b5bf-9ce16f39ea82 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:46.747833 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-88bddd59-364f-40cb-b5bf-9ce16f39ea82 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 200 len: 1241 microversion: 2.1 time: 0.068012 Aug 22 05:52:46.748514 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 512/1013] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:46 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:47.769528 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-41a72b72-78c1-4610-8875-bb403eae2535 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:47.770130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-41a72b72-78c1-4610-8875-bb403eae2535 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:47.776623 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41a72b72-78c1-4610-8875-bb403eae2535 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:47.777099 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41a72b72-78c1-4610-8875-bb403eae2535 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:47.777525 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41a72b72-78c1-4610-8875-bb403eae2535 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:47.778201 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41a72b72-78c1-4610-8875-bb403eae2535 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:47.778722 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41a72b72-78c1-4610-8875-bb403eae2535 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:47.779136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41a72b72-78c1-4610-8875-bb403eae2535 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:47.845662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-41a72b72-78c1-4610-8875-bb403eae2535 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:47.853986 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-41a72b72-78c1-4610-8875-bb403eae2535 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 200 len: 1299 microversion: 2.1 time: 0.088708 Aug 22 05:52:47.854564 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 502/1014] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:47 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:48.880028 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c5fe1ff4-a79a-4655-bbd0-ef3b775d3ffa tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:48.880642 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c5fe1ff4-a79a-4655-bbd0-ef3b775d3ffa tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:48.887734 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c5fe1ff4-a79a-4655-bbd0-ef3b775d3ffa tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:48.888710 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c5fe1ff4-a79a-4655-bbd0-ef3b775d3ffa tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:48.888935 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c5fe1ff4-a79a-4655-bbd0-ef3b775d3ffa tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:48.890063 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c5fe1ff4-a79a-4655-bbd0-ef3b775d3ffa tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:48.890503 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c5fe1ff4-a79a-4655-bbd0-ef3b775d3ffa tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:48.890927 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c5fe1ff4-a79a-4655-bbd0-ef3b775d3ffa tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:49.028080 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c5fe1ff4-a79a-4655-bbd0-ef3b775d3ffa tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:49.039700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c5fe1ff4-a79a-4655-bbd0-ef3b775d3ffa tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 200 len: 1367 microversion: 2.1 time: 0.163659 Aug 22 05:52:49.039955 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-9dbc6e7e-389c-456c-946a-789bee6f1903 req-0546de2e-12c1-4a52-bc95-da6d02697d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42a251a1-daba-4a3b-b499-d2e708b254c2", "tag": "dd5e252c-6929-4072-860f-8adc45551b9b"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:52:49.042381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 513/1015] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:48 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:49.050279 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-9dbc6e7e-389c-456c-946a-789bee6f1903 req-0546de2e-12c1-4a52-bc95-da6d02697d9b service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:49.050750 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-9dbc6e7e-389c-456c-946a-789bee6f1903 req-0546de2e-12c1-4a52-bc95-da6d02697d9b service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:49.051167 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-9dbc6e7e-389c-456c-946a-789bee6f1903 req-0546de2e-12c1-4a52-bc95-da6d02697d9b service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:49.064748 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-9dbc6e7e-389c-456c-946a-789bee6f1903 req-0546de2e-12c1-4a52-bc95-da6d02697d9b service nova] Creating event network-changed:dd5e252c-6929-4072-860f-8adc45551b9b for instance 42a251a1-daba-4a3b-b499-d2e708b254c2 on hv-cinder-85391 Aug 22 05:52:49.069883 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-9dbc6e7e-389c-456c-946a-789bee6f1903 req-0546de2e-12c1-4a52-bc95-da6d02697d9b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033904 Aug 22 05:52:49.070490 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 503/1016] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:52:50.065062 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-9d607310-7996-494b-ae78-b7820b529cd2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:50.065879 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-9d607310-7996-494b-ae78-b7820b529cd2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:50.074761 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9d607310-7996-494b-ae78-b7820b529cd2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:50.075395 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9d607310-7996-494b-ae78-b7820b529cd2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:50.076001 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9d607310-7996-494b-ae78-b7820b529cd2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:50.076917 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9d607310-7996-494b-ae78-b7820b529cd2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:50.077521 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9d607310-7996-494b-ae78-b7820b529cd2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:50.078077 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9d607310-7996-494b-ae78-b7820b529cd2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:50.213672 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-9d607310-7996-494b-ae78-b7820b529cd2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:50.226403 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-9d607310-7996-494b-ae78-b7820b529cd2 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 200 len: 1367 microversion: 2.1 time: 0.166682 Aug 22 05:52:50.227117 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 514/1017] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:50 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:51.253234 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-06b888ad-1c93-4c7d-981f-f19e0be66d9e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:51.254130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-06b888ad-1c93-4c7d-981f-f19e0be66d9e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:51.262824 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-06b888ad-1c93-4c7d-981f-f19e0be66d9e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:51.264458 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-06b888ad-1c93-4c7d-981f-f19e0be66d9e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:51.264642 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-06b888ad-1c93-4c7d-981f-f19e0be66d9e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:51.265475 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-06b888ad-1c93-4c7d-981f-f19e0be66d9e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:51.266036 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-06b888ad-1c93-4c7d-981f-f19e0be66d9e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:51.266556 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-06b888ad-1c93-4c7d-981f-f19e0be66d9e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:51.406402 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-06b888ad-1c93-4c7d-981f-f19e0be66d9e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:51.414469 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-06b888ad-1c93-4c7d-981f-f19e0be66d9e tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 200 len: 1367 microversion: 2.1 time: 0.166950 Aug 22 05:52:51.415127 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 504/1018] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:51 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:51.511062 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-aa2429bf-4dc0-4160-991b-f183c5fa61e5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:51.511661 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-aa2429bf-4dc0-4160-991b-f183c5fa61e5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:51.518900 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aa2429bf-4dc0-4160-991b-f183c5fa61e5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:51.519396 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aa2429bf-4dc0-4160-991b-f183c5fa61e5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:51.519918 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aa2429bf-4dc0-4160-991b-f183c5fa61e5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:51.520610 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aa2429bf-4dc0-4160-991b-f183c5fa61e5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:51.521059 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aa2429bf-4dc0-4160-991b-f183c5fa61e5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:51.521523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aa2429bf-4dc0-4160-991b-f183c5fa61e5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:51.548524 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-aa2429bf-4dc0-4160-991b-f183c5fa61e5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Going to try to terminate instance {{(pid=132497) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:52:51.630073 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-aa2429bf-4dc0-4160-991b-f183c5fa61e5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 204 len: 0 microversion: 2.1 time: 0.122745 Aug 22 05:52:51.634192 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 515/1019] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:52:51 2022] DELETE /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:52:51.639715 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-40dfbe69-6c50-4b1a-8fe8-7b269283259a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:51.640333 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-40dfbe69-6c50-4b1a-8fe8-7b269283259a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:51.646717 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40dfbe69-6c50-4b1a-8fe8-7b269283259a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:51.647187 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40dfbe69-6c50-4b1a-8fe8-7b269283259a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:51.647647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40dfbe69-6c50-4b1a-8fe8-7b269283259a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:51.648333 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40dfbe69-6c50-4b1a-8fe8-7b269283259a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:51.648773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40dfbe69-6c50-4b1a-8fe8-7b269283259a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:51.649185 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40dfbe69-6c50-4b1a-8fe8-7b269283259a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:51.780318 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-40dfbe69-6c50-4b1a-8fe8-7b269283259a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:51.791911 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-40dfbe69-6c50-4b1a-8fe8-7b269283259a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1578 microversion: 2.1 time: 0.156166 Aug 22 05:52:51.792616 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 505/1020] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:51 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:52.440752 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-2f11586a-a013-4fa4-96f6-1a21434dfff3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:52.441906 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-2f11586a-a013-4fa4-96f6-1a21434dfff3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:52.451808 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f11586a-a013-4fa4-96f6-1a21434dfff3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:52.452285 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f11586a-a013-4fa4-96f6-1a21434dfff3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:52.452704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f11586a-a013-4fa4-96f6-1a21434dfff3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:52.453383 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f11586a-a013-4fa4-96f6-1a21434dfff3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:52.453874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f11586a-a013-4fa4-96f6-1a21434dfff3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:52.454266 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2f11586a-a013-4fa4-96f6-1a21434dfff3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:52.596301 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-2f11586a-a013-4fa4-96f6-1a21434dfff3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:52.608270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-2f11586a-a013-4fa4-96f6-1a21434dfff3 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 200 len: 1367 microversion: 2.1 time: 0.174584 Aug 22 05:52:52.608823 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 516/1021] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:52 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:52.818631 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a2b59028-0f5a-4703-9ff2-3ae9b58adb36 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:52.819634 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a2b59028-0f5a-4703-9ff2-3ae9b58adb36 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:52.830795 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2b59028-0f5a-4703-9ff2-3ae9b58adb36 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:52.831613 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2b59028-0f5a-4703-9ff2-3ae9b58adb36 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:52.832352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2b59028-0f5a-4703-9ff2-3ae9b58adb36 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:52.833497 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2b59028-0f5a-4703-9ff2-3ae9b58adb36 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:52.834246 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2b59028-0f5a-4703-9ff2-3ae9b58adb36 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:52.834940 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2b59028-0f5a-4703-9ff2-3ae9b58adb36 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:52.978343 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a2b59028-0f5a-4703-9ff2-3ae9b58adb36 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:52.989627 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a2b59028-0f5a-4703-9ff2-3ae9b58adb36 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1578 microversion: 2.1 time: 0.177147 Aug 22 05:52:52.990464 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 506/1022] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:52 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:53.629224 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5e260377-d0dc-4d2b-b641-aa93e4057f41 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:53.629792 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5e260377-d0dc-4d2b-b641-aa93e4057f41 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:53.636522 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5e260377-d0dc-4d2b-b641-aa93e4057f41 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:53.636988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5e260377-d0dc-4d2b-b641-aa93e4057f41 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:53.637389 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5e260377-d0dc-4d2b-b641-aa93e4057f41 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:53.638262 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5e260377-d0dc-4d2b-b641-aa93e4057f41 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:53.638912 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5e260377-d0dc-4d2b-b641-aa93e4057f41 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:53.639484 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5e260377-d0dc-4d2b-b641-aa93e4057f41 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:53.780580 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5e260377-d0dc-4d2b-b641-aa93e4057f41 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:53.789048 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5e260377-d0dc-4d2b-b641-aa93e4057f41 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 200 len: 1367 microversion: 2.1 time: 0.163684 Aug 22 05:52:53.802416 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 517/1023] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:53 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:54.012357 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-36f7129d-82ec-47e4-9140-aa37f2b34371 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:54.012928 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-36f7129d-82ec-47e4-9140-aa37f2b34371 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:54.019602 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36f7129d-82ec-47e4-9140-aa37f2b34371 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:54.020112 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36f7129d-82ec-47e4-9140-aa37f2b34371 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:54.020542 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36f7129d-82ec-47e4-9140-aa37f2b34371 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:54.021233 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36f7129d-82ec-47e4-9140-aa37f2b34371 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:54.021678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36f7129d-82ec-47e4-9140-aa37f2b34371 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:54.022076 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36f7129d-82ec-47e4-9140-aa37f2b34371 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:54.090270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-986a9085-3a09-41b2-b66b-bd9a639b5fc1 req-705a335a-53c8-446c-a4da-e986a235c7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38dec1b-72b3-49d9-a7cc-aeb7883bae61", "name": "network-vif-deleted", "tag": "47de31c9-e5de-48fc-bc8d-c30da7ad0fa4"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:52:54.096624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-36f7129d-82ec-47e4-9140-aa37f2b34371 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:54.102167 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-986a9085-3a09-41b2-b66b-bd9a639b5fc1 req-705a335a-53c8-446c-a4da-e986a235c7b0 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:54.102863 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-986a9085-3a09-41b2-b66b-bd9a639b5fc1 req-705a335a-53c8-446c-a4da-e986a235c7b0 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:54.103289 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-986a9085-3a09-41b2-b66b-bd9a639b5fc1 req-705a335a-53c8-446c-a4da-e986a235c7b0 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:54.108096 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-36f7129d-82ec-47e4-9140-aa37f2b34371 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 200 len: 1511 microversion: 2.1 time: 0.099569 Aug 22 05:52:54.109033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 507/1024] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:54 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 1511 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:54.115225 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-986a9085-3a09-41b2-b66b-bd9a639b5fc1 req-705a335a-53c8-446c-a4da-e986a235c7b0 service nova] Creating event network-vif-deleted:47de31c9-e5de-48fc-bc8d-c30da7ad0fa4 for instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 on hv-cinder-85391 Aug 22 05:52:54.120240 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-986a9085-3a09-41b2-b66b-bd9a639b5fc1 req-705a335a-53c8-446c-a4da-e986a235c7b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033984 Aug 22 05:52:54.123799 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 518/1025] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:52:54.810026 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-43bb2999-c78b-4d83-8b49-2edabd55e6da tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:54.810629 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-43bb2999-c78b-4d83-8b49-2edabd55e6da tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:54.817631 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43bb2999-c78b-4d83-8b49-2edabd55e6da tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:54.818117 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43bb2999-c78b-4d83-8b49-2edabd55e6da tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:54.818549 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43bb2999-c78b-4d83-8b49-2edabd55e6da tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:54.819245 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43bb2999-c78b-4d83-8b49-2edabd55e6da tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:54.819728 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43bb2999-c78b-4d83-8b49-2edabd55e6da tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:54.820149 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43bb2999-c78b-4d83-8b49-2edabd55e6da tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:54.962147 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-43bb2999-c78b-4d83-8b49-2edabd55e6da tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:54.971708 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-43bb2999-c78b-4d83-8b49-2edabd55e6da tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 200 len: 1367 microversion: 2.1 time: 0.165918 Aug 22 05:52:54.972317 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 508/1026] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:54 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:55.133216 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-003a352d-c994-42cb-b2ad-9a0ec4a8a4f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:55.133905 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-003a352d-c994-42cb-b2ad-9a0ec4a8a4f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:55.140367 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-003a352d-c994-42cb-b2ad-9a0ec4a8a4f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:55.140850 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-003a352d-c994-42cb-b2ad-9a0ec4a8a4f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:55.141276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-003a352d-c994-42cb-b2ad-9a0ec4a8a4f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:55.141966 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-003a352d-c994-42cb-b2ad-9a0ec4a8a4f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:55.142405 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-003a352d-c994-42cb-b2ad-9a0ec4a8a4f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:55.142820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-003a352d-c994-42cb-b2ad-9a0ec4a8a4f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:55.156615 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-003a352d-c994-42cb-b2ad-9a0ec4a8a4f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] HTTP exception thrown: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-003a352d-c994-42cb-b2ad-9a0ec4a8a4f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Request method failure captured: Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 HTTP/1.1 Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxj9WcOCDiLZOGhHqYXlJYzqSdD-Nl-Bk9l-DEeqx3O4nIC3myVhi19DiJ3kmU3m1ZUv4yq_gciqCLOoekRlgMfBLXBLnKhpp3s_lAMpZzlN7KONEbkBZMcMmnHBSDxMxjs-xyzX8b3a7bBHHdHThuaEtflzSwAsbu3-Sk1cr48AUtg Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: 6d3a9f50ec2d4fff938fcd6a79f5cdc9 Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-TestVolumeBootPattern-130227501 Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:52:55.158085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:52:55.159810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6d3a9f50ec2d4fff938fcd6a79f5cdc9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d3a9f50ec2d4fff938fcd6a79f5cdc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d3a9f50ec2d4fff938fcd6a79f5cdc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6d3a9f50ec2d4fff938fcd6a79f5cdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:52:55.159810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-TestVolumeBootPattern-130227501 Aug 22 05:52:55.159810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: 6d3a9f50ec2d4fff938fcd6a79f5cdc9 Aug 22 05:52:55.159810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-TestVolumeBootPattern-130227501 Aug 22 05:52:55.159810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-TestVolumeBootPattern-130227501-project Aug 22 05:52:55.159810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:52:55.159810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:52:55.159810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: bb6d35f57b804ba5afa4ab86c46cd7c3 Aug 22 05:52:55.159810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-TestVolumeBootPattern-130227501-project Aug 22 05:52:55.159810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:52:55.159810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. Aug 22 05:52:55.159810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': 'c38dec1b-72b3-49d9-a7cc-aeb7883bae61'} Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:52:55.164459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. Aug 22 05:52:55.165888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:52:55.167172 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-003a352d-c994-42cb-b2ad-9a0ec4a8a4f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Returning 404 to user: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:52:55.167172 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-003a352d-c994-42cb-b2ad-9a0ec4a8a4f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 404 len: 111 microversion: 2.1 time: 0.031198 Aug 22 05:52:55.167172 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 519/1027] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:55 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:52:55.208883 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-555841038", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1539589973", "security_groups": [{"name": "tempest-secgroup-smoke-727561452"}], "block_device_mapping_v2": [{"uuid": "7d96dbc0-974b-403b-bb42-12b77e8bddf7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eaf2e3cb-8f86-46d8-9db4-d025de139d15"}]}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:52:55.303142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-fcb00827-c93c-4fc5-a43a-ad2a7fa2a4cb req-11545dd2-7361-4e5b-9fe1-b20be29d6622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42a251a1-daba-4a3b-b499-d2e708b254c2", "name": "network-vif-plugged", "status": "completed", "tag": "dd5e252c-6929-4072-860f-8adc45551b9b"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:52:55.313955 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-fcb00827-c93c-4fc5-a43a-ad2a7fa2a4cb req-11545dd2-7361-4e5b-9fe1-b20be29d6622 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:55.314695 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-fcb00827-c93c-4fc5-a43a-ad2a7fa2a4cb req-11545dd2-7361-4e5b-9fe1-b20be29d6622 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:55.315191 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-fcb00827-c93c-4fc5-a43a-ad2a7fa2a4cb req-11545dd2-7361-4e5b-9fe1-b20be29d6622 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:55.327250 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] validate_networks() for [('eaf2e3cb-8f86-46d8-9db4-d025de139d15', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:52:55.328014 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-fcb00827-c93c-4fc5-a43a-ad2a7fa2a4cb req-11545dd2-7361-4e5b-9fe1-b20be29d6622 service nova] Creating event network-vif-plugged:dd5e252c-6929-4072-860f-8adc45551b9b for instance 42a251a1-daba-4a3b-b499-d2e708b254c2 on hv-cinder-85391 Aug 22 05:52:55.333192 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-fcb00827-c93c-4fc5-a43a-ad2a7fa2a4cb req-11545dd2-7361-4e5b-9fe1-b20be29d6622 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033768 Aug 22 05:52:55.334280 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 520/1028] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:52:55.728428 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:52:55.728848 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:52:55.729314 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:52:55.729690 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:52:55.730094 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:52:55.739808 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:55.740293 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:55.740770 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:55.741495 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:55.741985 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:55.742399 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:55.759597 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Getting quotas for project 6d3a9f50ec2d4fff938fcd6a79f5cdc9. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:52:55.763624 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Getting quotas for user bb6d35f57b804ba5afa4ab86c46cd7c3 and project 6d3a9f50ec2d4fff938fcd6a79f5cdc9. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:52:55.824256 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:52:55.826400 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d96dbc0-974b-403b-bb42-12b77e8bddf7',volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:52:55.967608 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9bce7f7a-1b81-49e9-84d6-a5cb74ae79f0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.762354 Aug 22 05:52:55.968265 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 509/1029] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:52:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:52:55.980179 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b6ef3d1a-3fa3-4852-bb9d-a133df7f85dd tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:55.981001 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b6ef3d1a-3fa3-4852-bb9d-a133df7f85dd tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:55.992762 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-aa1e2713-f2cf-46ca-ad02-0fe5973b266b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:55.993273 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-aa1e2713-f2cf-46ca-ad02-0fe5973b266b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:56.000868 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa1e2713-f2cf-46ca-ad02-0fe5973b266b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:56.001203 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa1e2713-f2cf-46ca-ad02-0fe5973b266b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:56.001631 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa1e2713-f2cf-46ca-ad02-0fe5973b266b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:56.002738 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa1e2713-f2cf-46ca-ad02-0fe5973b266b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:56.003526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa1e2713-f2cf-46ca-ad02-0fe5973b266b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:56.004279 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa1e2713-f2cf-46ca-ad02-0fe5973b266b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:56.045917 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b6ef3d1a-3fa3-4852-bb9d-a133df7f85dd tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:56.054757 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b6ef3d1a-3fa3-4852-bb9d-a133df7f85dd tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1094 microversion: 2.1 time: 0.079112 Aug 22 05:52:56.055921 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 521/1030] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:55 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:56.144284 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-aa1e2713-f2cf-46ca-ad02-0fe5973b266b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:56.152178 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-aa1e2713-f2cf-46ca-ad02-0fe5973b266b tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 200 len: 1367 microversion: 2.1 time: 0.163543 Aug 22 05:52:56.152754 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 510/1031] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:55 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:57.076738 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-314f70e4-addb-4989-8325-55893b69ddcf tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:57.077536 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-314f70e4-addb-4989-8325-55893b69ddcf tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:57.085339 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-314f70e4-addb-4989-8325-55893b69ddcf tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:57.085811 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-314f70e4-addb-4989-8325-55893b69ddcf tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:57.086245 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-314f70e4-addb-4989-8325-55893b69ddcf tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:57.086934 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-314f70e4-addb-4989-8325-55893b69ddcf tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:57.087380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-314f70e4-addb-4989-8325-55893b69ddcf tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:57.087829 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-314f70e4-addb-4989-8325-55893b69ddcf tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:57.150156 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-314f70e4-addb-4989-8325-55893b69ddcf tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:57.158330 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-314f70e4-addb-4989-8325-55893b69ddcf tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1192 microversion: 2.1 time: 0.085641 Aug 22 05:52:57.158900 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 522/1032] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:57 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:52:57.174454 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-407ab8a7-17c2-4c82-b8af-eb45a13628b0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:57.175405 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-407ab8a7-17c2-4c82-b8af-eb45a13628b0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:57.185818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-407ab8a7-17c2-4c82-b8af-eb45a13628b0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:57.186435 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-407ab8a7-17c2-4c82-b8af-eb45a13628b0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:57.186860 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-407ab8a7-17c2-4c82-b8af-eb45a13628b0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:57.187546 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-407ab8a7-17c2-4c82-b8af-eb45a13628b0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:57.188021 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-407ab8a7-17c2-4c82-b8af-eb45a13628b0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:57.188436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-407ab8a7-17c2-4c82-b8af-eb45a13628b0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:57.323385 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-407ab8a7-17c2-4c82-b8af-eb45a13628b0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:57.331990 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-407ab8a7-17c2-4c82-b8af-eb45a13628b0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 200 len: 1556 microversion: 2.1 time: 0.162297 Aug 22 05:52:57.347829 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 511/1033] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:57 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:57.353780 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-3a72774c-a9aa-4f17-9e1b-726f848bca8a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:57.353900 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-3a72774c-a9aa-4f17-9e1b-726f848bca8a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:57.361920 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3a72774c-a9aa-4f17-9e1b-726f848bca8a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:57.362409 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3a72774c-a9aa-4f17-9e1b-726f848bca8a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:57.362869 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3a72774c-a9aa-4f17-9e1b-726f848bca8a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:57.363568 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3a72774c-a9aa-4f17-9e1b-726f848bca8a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:57.364049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3a72774c-a9aa-4f17-9e1b-726f848bca8a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:57.364468 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-3a72774c-a9aa-4f17-9e1b-726f848bca8a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:57.383165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:57.456330 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-3a72774c-a9aa-4f17-9e1b-726f848bca8a tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106770 Aug 22 05:52:57.457605 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 523/1034] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Aug 22 05:52:57 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:52:58.179551 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-89cea020-9e13-4152-9f2f-a972363e26d5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:58.180559 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-89cea020-9e13-4152-9f2f-a972363e26d5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:58.188218 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-89cea020-9e13-4152-9f2f-a972363e26d5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:58.188890 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-89cea020-9e13-4152-9f2f-a972363e26d5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:58.189410 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-89cea020-9e13-4152-9f2f-a972363e26d5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:58.190257 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-89cea020-9e13-4152-9f2f-a972363e26d5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:58.190823 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-89cea020-9e13-4152-9f2f-a972363e26d5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:58.191341 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-89cea020-9e13-4152-9f2f-a972363e26d5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:58.270219 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-89cea020-9e13-4152-9f2f-a972363e26d5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:58.274370 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:58.282796 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-89cea020-9e13-4152-9f2f-a972363e26d5 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1198 microversion: 2.1 time: 0.107782 Aug 22 05:52:58.284080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 512/1035] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:58 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1198 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:52:58.792468 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-85dd47ce-7172-47d5-bf2c-d15f127efad2 req-f1897e55-f09c-455c-8bdd-945f77bd370c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42a251a1-daba-4a3b-b499-d2e708b254c2", "tag": "dd5e252c-6929-4072-860f-8adc45551b9b"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:52:58.803122 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-85dd47ce-7172-47d5-bf2c-d15f127efad2 req-f1897e55-f09c-455c-8bdd-945f77bd370c service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:58.803621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-85dd47ce-7172-47d5-bf2c-d15f127efad2 req-f1897e55-f09c-455c-8bdd-945f77bd370c service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:58.804293 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-85dd47ce-7172-47d5-bf2c-d15f127efad2 req-f1897e55-f09c-455c-8bdd-945f77bd370c service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:58.816446 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-85dd47ce-7172-47d5-bf2c-d15f127efad2 req-f1897e55-f09c-455c-8bdd-945f77bd370c service nova] Creating event network-changed:dd5e252c-6929-4072-860f-8adc45551b9b for instance 42a251a1-daba-4a3b-b499-d2e708b254c2 on hv-cinder-85391 Aug 22 05:52:58.821370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-85dd47ce-7172-47d5-bf2c-d15f127efad2 req-f1897e55-f09c-455c-8bdd-945f77bd370c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033714 Aug 22 05:52:58.822535 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 524/1036] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:52:59.026760 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-2f99cdfe-c857-46dc-853e-568c00767695 req-622baf2a-e942-49e0-838d-85c6800cb067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27f5503f-65ce-4e35-8184-6fe3a457f78f", "tag": "b090e134-f7c1-451f-a8db-bbebbb63e01e"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:52:59.051249 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-2f99cdfe-c857-46dc-853e-568c00767695 req-622baf2a-e942-49e0-838d-85c6800cb067 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:59.052599 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-2f99cdfe-c857-46dc-853e-568c00767695 req-622baf2a-e942-49e0-838d-85c6800cb067 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:59.053710 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-2f99cdfe-c857-46dc-853e-568c00767695 req-622baf2a-e942-49e0-838d-85c6800cb067 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:59.069053 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-2f99cdfe-c857-46dc-853e-568c00767695 req-622baf2a-e942-49e0-838d-85c6800cb067 service nova] Creating event network-changed:b090e134-f7c1-451f-a8db-bbebbb63e01e for instance 27f5503f-65ce-4e35-8184-6fe3a457f78f on hv-cinder-85391 Aug 22 05:52:59.074786 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-2f99cdfe-c857-46dc-853e-568c00767695 req-622baf2a-e942-49e0-838d-85c6800cb067 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053041 Aug 22 05:52:59.076188 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 513/1037] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:52:59.304535 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-32a6dacf-299d-4f1c-a2da-07c3f899d6c3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:52:59.305233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-32a6dacf-299d-4f1c-a2da-07c3f899d6c3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:52:59.313446 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32a6dacf-299d-4f1c-a2da-07c3f899d6c3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:59.315009 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32a6dacf-299d-4f1c-a2da-07c3f899d6c3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:59.315656 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32a6dacf-299d-4f1c-a2da-07c3f899d6c3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:59.316958 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32a6dacf-299d-4f1c-a2da-07c3f899d6c3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:52:59.318010 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32a6dacf-299d-4f1c-a2da-07c3f899d6c3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:52:59.319049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-32a6dacf-299d-4f1c-a2da-07c3f899d6c3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:52:59.528002 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-32a6dacf-299d-4f1c-a2da-07c3f899d6c3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:52:59.536225 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-32a6dacf-299d-4f1c-a2da-07c3f899d6c3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1265 microversion: 2.1 time: 0.236142 Aug 22 05:52:59.536782 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 525/1038] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:52:59 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:53:00.560784 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c1ee2b63-2ac4-4aac-ae95-3781baecbe4e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:53:00.561587 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c1ee2b63-2ac4-4aac-ae95-3781baecbe4e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:53:00.565436 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:53:00.571918 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1ee2b63-2ac4-4aac-ae95-3781baecbe4e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:00.572485 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1ee2b63-2ac4-4aac-ae95-3781baecbe4e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:00.572916 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1ee2b63-2ac4-4aac-ae95-3781baecbe4e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:00.573614 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1ee2b63-2ac4-4aac-ae95-3781baecbe4e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:00.574064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1ee2b63-2ac4-4aac-ae95-3781baecbe4e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:00.574476 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1ee2b63-2ac4-4aac-ae95-3781baecbe4e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:00.731867 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c1ee2b63-2ac4-4aac-ae95-3781baecbe4e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:53:00.740402 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c1ee2b63-2ac4-4aac-ae95-3781baecbe4e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1265 microversion: 2.1 time: 0.186620 Aug 22 05:53:00.740980 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 514/1039] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:53:00 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:53:01.766421 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-f62c816f-ee7b-405b-9d8b-90a378468734 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:53:01.767366 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-f62c816f-ee7b-405b-9d8b-90a378468734 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:53:01.771322 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:53:01.780870 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f62c816f-ee7b-405b-9d8b-90a378468734 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:01.781359 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f62c816f-ee7b-405b-9d8b-90a378468734 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:01.781793 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f62c816f-ee7b-405b-9d8b-90a378468734 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:01.782496 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f62c816f-ee7b-405b-9d8b-90a378468734 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:01.782926 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f62c816f-ee7b-405b-9d8b-90a378468734 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:01.783348 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-f62c816f-ee7b-405b-9d8b-90a378468734 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:01.923124 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-f62c816f-ee7b-405b-9d8b-90a378468734 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:53:01.931011 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-f62c816f-ee7b-405b-9d8b-90a378468734 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1265 microversion: 2.1 time: 0.171897 Aug 22 05:53:01.931596 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 526/1040] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:53:01 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:53:02.954637 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8c5e40a7-e8a2-4afa-87c4-98d6465f5f33 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:53:02.955214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8c5e40a7-e8a2-4afa-87c4-98d6465f5f33 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:53:02.962521 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8c5e40a7-e8a2-4afa-87c4-98d6465f5f33 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:02.963007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8c5e40a7-e8a2-4afa-87c4-98d6465f5f33 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:02.963439 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8c5e40a7-e8a2-4afa-87c4-98d6465f5f33 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:02.964160 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8c5e40a7-e8a2-4afa-87c4-98d6465f5f33 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:02.964970 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8c5e40a7-e8a2-4afa-87c4-98d6465f5f33 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:02.965444 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8c5e40a7-e8a2-4afa-87c4-98d6465f5f33 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:03.108766 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8c5e40a7-e8a2-4afa-87c4-98d6465f5f33 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:53:03.118339 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8c5e40a7-e8a2-4afa-87c4-98d6465f5f33 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1265 microversion: 2.1 time: 0.169283 Aug 22 05:53:03.119014 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 515/1041] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:53:02 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:53:04.141753 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-04050761-8e47-4405-8192-ae69184716ee tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:53:04.142331 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-04050761-8e47-4405-8192-ae69184716ee tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:53:04.150336 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04050761-8e47-4405-8192-ae69184716ee tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:04.150812 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04050761-8e47-4405-8192-ae69184716ee tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:04.151237 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04050761-8e47-4405-8192-ae69184716ee tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:04.151951 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04050761-8e47-4405-8192-ae69184716ee tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:04.152392 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04050761-8e47-4405-8192-ae69184716ee tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:04.152801 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-04050761-8e47-4405-8192-ae69184716ee tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:04.299734 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-04050761-8e47-4405-8192-ae69184716ee tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:53:04.307695 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-04050761-8e47-4405-8192-ae69184716ee tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1265 microversion: 2.1 time: 0.169897 Aug 22 05:53:04.308255 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 527/1042] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:53:04 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:53:05.333259 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a73cd41d-9545-4a1a-ac5b-ef126aa02afa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:53:05.334294 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a73cd41d-9545-4a1a-ac5b-ef126aa02afa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:53:05.345647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a73cd41d-9545-4a1a-ac5b-ef126aa02afa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:05.346433 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a73cd41d-9545-4a1a-ac5b-ef126aa02afa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:05.347189 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a73cd41d-9545-4a1a-ac5b-ef126aa02afa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:05.348551 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a73cd41d-9545-4a1a-ac5b-ef126aa02afa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:05.349292 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a73cd41d-9545-4a1a-ac5b-ef126aa02afa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:05.349980 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a73cd41d-9545-4a1a-ac5b-ef126aa02afa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:05.493806 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a73cd41d-9545-4a1a-ac5b-ef126aa02afa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:53:05.503386 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a73cd41d-9545-4a1a-ac5b-ef126aa02afa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1265 microversion: 2.1 time: 0.176978 Aug 22 05:53:05.504513 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 516/1043] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:53:05 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:53:06.528397 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e69ee5a7-61b0-4668-abeb-a56284d5bf44 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:53:06.528996 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e69ee5a7-61b0-4668-abeb-a56284d5bf44 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:53:06.533347 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=8 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:53:06.537806 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e69ee5a7-61b0-4668-abeb-a56284d5bf44 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:06.538286 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e69ee5a7-61b0-4668-abeb-a56284d5bf44 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:06.538713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e69ee5a7-61b0-4668-abeb-a56284d5bf44 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:06.539409 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e69ee5a7-61b0-4668-abeb-a56284d5bf44 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:06.539877 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e69ee5a7-61b0-4668-abeb-a56284d5bf44 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:06.540302 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e69ee5a7-61b0-4668-abeb-a56284d5bf44 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:06.676665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e69ee5a7-61b0-4668-abeb-a56284d5bf44 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:53:06.686235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e69ee5a7-61b0-4668-abeb-a56284d5bf44 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1265 microversion: 2.1 time: 0.161473 Aug 22 05:53:06.686823 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 528/1044] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:53:06 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:53:07.710591 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2679a677-f51f-4f3d-b407-00da268eb6ed tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:53:07.711635 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2679a677-f51f-4f3d-b407-00da268eb6ed tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:53:07.714861 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=4 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:53:07.716159 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=12 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:53:07.724616 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2679a677-f51f-4f3d-b407-00da268eb6ed tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:07.725094 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2679a677-f51f-4f3d-b407-00da268eb6ed tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:07.725522 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2679a677-f51f-4f3d-b407-00da268eb6ed tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:07.726203 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2679a677-f51f-4f3d-b407-00da268eb6ed tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:07.726641 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2679a677-f51f-4f3d-b407-00da268eb6ed tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:07.727054 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2679a677-f51f-4f3d-b407-00da268eb6ed tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:07.884193 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2679a677-f51f-4f3d-b407-00da268eb6ed tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:53:07.892440 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2679a677-f51f-4f3d-b407-00da268eb6ed tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1265 microversion: 2.1 time: 0.188275 Aug 22 05:53:07.893143 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 517/1045] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:53:07 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:53:08.917822 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c1509a55-4ae2-432c-aa70-c1a48841c32f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:53:08.918715 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c1509a55-4ae2-432c-aa70-c1a48841c32f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:53:08.927931 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c1509a55-4ae2-432c-aa70-c1a48841c32f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:08.928410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c1509a55-4ae2-432c-aa70-c1a48841c32f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:08.928835 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c1509a55-4ae2-432c-aa70-c1a48841c32f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:08.929527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c1509a55-4ae2-432c-aa70-c1a48841c32f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:08.929975 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c1509a55-4ae2-432c-aa70-c1a48841c32f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:08.930395 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c1509a55-4ae2-432c-aa70-c1a48841c32f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:09.071413 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c1509a55-4ae2-432c-aa70-c1a48841c32f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:53:09.079798 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c1509a55-4ae2-432c-aa70-c1a48841c32f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1265 microversion: 2.1 time: 0.168531 Aug 22 05:53:09.080469 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 529/1046] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:53:08 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:53:10.103419 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d90768b8-e21c-4e3f-89f5-1c4914bdab2f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:53:10.104149 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d90768b8-e21c-4e3f-89f5-1c4914bdab2f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:53:10.112811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d90768b8-e21c-4e3f-89f5-1c4914bdab2f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:10.113401 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d90768b8-e21c-4e3f-89f5-1c4914bdab2f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:10.113933 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d90768b8-e21c-4e3f-89f5-1c4914bdab2f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:10.114778 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d90768b8-e21c-4e3f-89f5-1c4914bdab2f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:10.115331 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d90768b8-e21c-4e3f-89f5-1c4914bdab2f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:10.115886 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d90768b8-e21c-4e3f-89f5-1c4914bdab2f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:10.261515 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d90768b8-e21c-4e3f-89f5-1c4914bdab2f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:53:10.270183 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d90768b8-e21c-4e3f-89f5-1c4914bdab2f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1265 microversion: 2.1 time: 0.171646 Aug 22 05:53:10.270754 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 518/1047] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:53:10 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:53:11.298035 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-cf9cf4d8-7ec2-40bc-9c99-dfc0d7ee2406 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:53:11.298678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-cf9cf4d8-7ec2-40bc-9c99-dfc0d7ee2406 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:53:11.305666 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cf9cf4d8-7ec2-40bc-9c99-dfc0d7ee2406 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:11.306143 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cf9cf4d8-7ec2-40bc-9c99-dfc0d7ee2406 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:11.306565 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cf9cf4d8-7ec2-40bc-9c99-dfc0d7ee2406 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:11.307256 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cf9cf4d8-7ec2-40bc-9c99-dfc0d7ee2406 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:11.307737 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cf9cf4d8-7ec2-40bc-9c99-dfc0d7ee2406 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:11.308153 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cf9cf4d8-7ec2-40bc-9c99-dfc0d7ee2406 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:11.447551 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-cf9cf4d8-7ec2-40bc-9c99-dfc0d7ee2406 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:53:11.456205 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-cf9cf4d8-7ec2-40bc-9c99-dfc0d7ee2406 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1265 microversion: 2.1 time: 0.161705 Aug 22 05:53:11.456699 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 530/1048] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:53:11 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:53:11.510769 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-3ebefc31-444a-4ff7-8b77-f33b35059c37 req-c07fed11-0d6c-470d-85a6-b39bd765e597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27f5503f-65ce-4e35-8184-6fe3a457f78f", "name": "network-vif-plugged", "status": "completed", "tag": "b090e134-f7c1-451f-a8db-bbebbb63e01e"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:53:11.522395 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-3ebefc31-444a-4ff7-8b77-f33b35059c37 req-c07fed11-0d6c-470d-85a6-b39bd765e597 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:11.522887 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-3ebefc31-444a-4ff7-8b77-f33b35059c37 req-c07fed11-0d6c-470d-85a6-b39bd765e597 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:11.523289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-3ebefc31-444a-4ff7-8b77-f33b35059c37 req-c07fed11-0d6c-470d-85a6-b39bd765e597 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:11.535213 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-3ebefc31-444a-4ff7-8b77-f33b35059c37 req-c07fed11-0d6c-470d-85a6-b39bd765e597 service nova] Creating event network-vif-plugged:b090e134-f7c1-451f-a8db-bbebbb63e01e for instance 27f5503f-65ce-4e35-8184-6fe3a457f78f on hv-cinder-85391 Aug 22 05:53:11.541031 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-3ebefc31-444a-4ff7-8b77-f33b35059c37 req-c07fed11-0d6c-470d-85a6-b39bd765e597 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033957 Aug 22 05:53:11.541635 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 519/1049] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:53:12.482847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-d119d92f-a68e-44b7-934e-1201a5a26921 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:53:12.483886 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-d119d92f-a68e-44b7-934e-1201a5a26921 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:53:12.491314 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d119d92f-a68e-44b7-934e-1201a5a26921 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:12.491832 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d119d92f-a68e-44b7-934e-1201a5a26921 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:12.492264 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d119d92f-a68e-44b7-934e-1201a5a26921 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:12.492954 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d119d92f-a68e-44b7-934e-1201a5a26921 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:12.493404 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d119d92f-a68e-44b7-934e-1201a5a26921 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:12.493827 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-d119d92f-a68e-44b7-934e-1201a5a26921 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:12.631846 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-d119d92f-a68e-44b7-934e-1201a5a26921 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:53:12.639839 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-d119d92f-a68e-44b7-934e-1201a5a26921 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1265 microversion: 2.1 time: 0.164757 Aug 22 05:53:12.640411 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 531/1050] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:53:12 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:53:13.665580 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8b03cf2a-c0a6-4867-9a88-f8e11664231f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:53:13.666478 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8b03cf2a-c0a6-4867-9a88-f8e11664231f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:53:13.675154 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8b03cf2a-c0a6-4867-9a88-f8e11664231f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:13.675827 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8b03cf2a-c0a6-4867-9a88-f8e11664231f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:13.676374 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8b03cf2a-c0a6-4867-9a88-f8e11664231f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:13.677227 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8b03cf2a-c0a6-4867-9a88-f8e11664231f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:13.677784 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8b03cf2a-c0a6-4867-9a88-f8e11664231f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:13.678304 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8b03cf2a-c0a6-4867-9a88-f8e11664231f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:13.882222 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8b03cf2a-c0a6-4867-9a88-f8e11664231f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:53:13.890594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8b03cf2a-c0a6-4867-9a88-f8e11664231f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1451 microversion: 2.1 time: 0.231815 Aug 22 05:53:13.891173 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 520/1051] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:53:13 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1451 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:53:13.911316 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-148c56fd-213d-4f4e-b5c4-94511d592e2e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:53:13.911966 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-148c56fd-213d-4f4e-b5c4-94511d592e2e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:53:13.918790 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-148c56fd-213d-4f4e-b5c4-94511d592e2e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:13.919216 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-148c56fd-213d-4f4e-b5c4-94511d592e2e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:13.919676 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-148c56fd-213d-4f4e-b5c4-94511d592e2e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:13.920374 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-148c56fd-213d-4f4e-b5c4-94511d592e2e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:13.920823 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-148c56fd-213d-4f4e-b5c4-94511d592e2e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:13.921245 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-148c56fd-213d-4f4e-b5c4-94511d592e2e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:14.121323 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-148c56fd-213d-4f4e-b5c4-94511d592e2e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:53:14.129629 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-148c56fd-213d-4f4e-b5c4-94511d592e2e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1451 microversion: 2.1 time: 0.222542 Aug 22 05:53:14.130243 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 532/1052] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:53:13 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1451 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:53:16.066600 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-252447cf-da2c-4576-aff6-6a4a0a9a62fa req-5bff7ee1-d269-4d66-816a-0c4fdc41df7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27f5503f-65ce-4e35-8184-6fe3a457f78f", "tag": "b090e134-f7c1-451f-a8db-bbebbb63e01e"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:53:16.076515 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-252447cf-da2c-4576-aff6-6a4a0a9a62fa req-5bff7ee1-d269-4d66-816a-0c4fdc41df7a service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:53:16.076967 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-252447cf-da2c-4576-aff6-6a4a0a9a62fa req-5bff7ee1-d269-4d66-816a-0c4fdc41df7a service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:53:16.077422 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-252447cf-da2c-4576-aff6-6a4a0a9a62fa req-5bff7ee1-d269-4d66-816a-0c4fdc41df7a service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:53:16.088690 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-252447cf-da2c-4576-aff6-6a4a0a9a62fa req-5bff7ee1-d269-4d66-816a-0c4fdc41df7a service nova] Creating event network-changed:b090e134-f7c1-451f-a8db-bbebbb63e01e for instance 27f5503f-65ce-4e35-8184-6fe3a457f78f on hv-cinder-85391 Aug 22 05:53:16.093991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-252447cf-da2c-4576-aff6-6a4a0a9a62fa req-5bff7ee1-d269-4d66-816a-0c4fdc41df7a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031950 Aug 22 05:53:16.094613 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 521/1053] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:53:20.820217 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 05:53:20.820755 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Mon Aug 22 05:53:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 05:54:03.526654 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-764b868a-3490-4996-a29b-b2145f7acece tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:03.527838 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-764b868a-3490-4996-a29b-b2145f7acece tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:03.530723 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=13 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:03.531824 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=50 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:03.539271 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-764b868a-3490-4996-a29b-b2145f7acece tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:03.539785 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-764b868a-3490-4996-a29b-b2145f7acece tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:03.540225 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-764b868a-3490-4996-a29b-b2145f7acece tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:03.540952 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-764b868a-3490-4996-a29b-b2145f7acece tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:03.541401 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-764b868a-3490-4996-a29b-b2145f7acece tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:03.541813 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-764b868a-3490-4996-a29b-b2145f7acece tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:03.566806 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-764b868a-3490-4996-a29b-b2145f7acece tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2/ips" status: 200 len: 148 microversion: 2.1 time: 0.047031 Aug 22 05:54:03.567394 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 533/1054] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 22 05:54:03 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2/ips => generated 148 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:54:04.923770 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-cdfe3490-fa3e-47f1-b7eb-bd8228ac7fa0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62b9c8c4-c69a-4434-9f5c-39ca98180659"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:54:04.926632 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-cdfe3490-fa3e-47f1-b7eb-bd8228ac7fa0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:04.929957 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=15 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:04.930585 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=42 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:04.934896 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cdfe3490-fa3e-47f1-b7eb-bd8228ac7fa0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:04.935379 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cdfe3490-fa3e-47f1-b7eb-bd8228ac7fa0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:04.935881 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cdfe3490-fa3e-47f1-b7eb-bd8228ac7fa0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:04.936586 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cdfe3490-fa3e-47f1-b7eb-bd8228ac7fa0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:04.937034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cdfe3490-fa3e-47f1-b7eb-bd8228ac7fa0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:04.937452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cdfe3490-fa3e-47f1-b7eb-bd8228ac7fa0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:05.230638 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-cdfe3490-fa3e-47f1-b7eb-bd8228ac7fa0 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "POST /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311609 Aug 22 05:54:05.231278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 522/1055] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 22 05:54:04 2022] POST /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:54:12.938458 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ed01d0ad-0edc-4e1b-a9cc-e66dd7f2d8f5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:12.939077 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ed01d0ad-0edc-4e1b-a9cc-e66dd7f2d8f5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:12.945055 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed01d0ad-0edc-4e1b-a9cc-e66dd7f2d8f5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:12.945549 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed01d0ad-0edc-4e1b-a9cc-e66dd7f2d8f5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:12.946322 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed01d0ad-0edc-4e1b-a9cc-e66dd7f2d8f5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:12.946641 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed01d0ad-0edc-4e1b-a9cc-e66dd7f2d8f5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:12.947092 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed01d0ad-0edc-4e1b-a9cc-e66dd7f2d8f5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:12.947502 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ed01d0ad-0edc-4e1b-a9cc-e66dd7f2d8f5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:13.028597 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.objects.instance [None req-ed01d0ad-0edc-4e1b-a9cc-e66dd7f2d8f5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lazy-loading 'services' on Instance uuid 42a251a1-daba-4a3b-b499-d2e708b254c2 {{(pid=132497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:54:13.112829 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ed01d0ad-0edc-4e1b-a9cc-e66dd7f2d8f5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "DELETE /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2/os-volume_attachments/62b9c8c4-c69a-4434-9f5c-39ca98180659" status: 202 len: 0 microversion: 2.1 time: 0.178295 Aug 22 05:54:13.113436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 534/1056] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 22 05:54:12 2022] DELETE /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2/os-volume_attachments/62b9c8c4-c69a-4434-9f5c-39ca98180659 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:54:13.123250 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f8eb52ac-7a72-4566-a012-e3cf518ea45c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:13.125628 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f8eb52ac-7a72-4566-a012-e3cf518ea45c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:13.132798 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f8eb52ac-7a72-4566-a012-e3cf518ea45c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:13.133272 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f8eb52ac-7a72-4566-a012-e3cf518ea45c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:13.133696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f8eb52ac-7a72-4566-a012-e3cf518ea45c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:13.134595 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f8eb52ac-7a72-4566-a012-e3cf518ea45c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:13.135041 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f8eb52ac-7a72-4566-a012-e3cf518ea45c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:13.135507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f8eb52ac-7a72-4566-a012-e3cf518ea45c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:13.170414 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f8eb52ac-7a72-4566-a012-e3cf518ea45c tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051957 Aug 22 05:54:13.171552 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 523/1057] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 22 05:54:13 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:54:14.189458 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c12a0423-afd8-437e-8e0d-7fbd4118238f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:14.193167 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c12a0423-afd8-437e-8e0d-7fbd4118238f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:14.200258 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c12a0423-afd8-437e-8e0d-7fbd4118238f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:14.200732 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c12a0423-afd8-437e-8e0d-7fbd4118238f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:14.201155 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c12a0423-afd8-437e-8e0d-7fbd4118238f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:14.201830 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c12a0423-afd8-437e-8e0d-7fbd4118238f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:14.202273 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c12a0423-afd8-437e-8e0d-7fbd4118238f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:14.202727 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c12a0423-afd8-437e-8e0d-7fbd4118238f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:14.233913 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c12a0423-afd8-437e-8e0d-7fbd4118238f tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053403 Aug 22 05:54:14.234448 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 535/1058] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 22 05:54:14 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 05:54:14.299031 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-28f3453c-2bd3-4b71-9a7e-0ecf30d5c542 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:14.299567 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-28f3453c-2bd3-4b71-9a7e-0ecf30d5c542 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:14.309881 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-28f3453c-2bd3-4b71-9a7e-0ecf30d5c542 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:14.310529 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-28f3453c-2bd3-4b71-9a7e-0ecf30d5c542 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:14.311089 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-28f3453c-2bd3-4b71-9a7e-0ecf30d5c542 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:14.312110 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-28f3453c-2bd3-4b71-9a7e-0ecf30d5c542 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:14.312706 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-28f3453c-2bd3-4b71-9a7e-0ecf30d5c542 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:14.313287 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-28f3453c-2bd3-4b71-9a7e-0ecf30d5c542 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:14.342149 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-28f3453c-2bd3-4b71-9a7e-0ecf30d5c542 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:54:14.418332 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-28f3453c-2bd3-4b71-9a7e-0ecf30d5c542 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "DELETE /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 204 len: 0 microversion: 2.1 time: 0.125369 Aug 22 05:54:14.418921 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 524/1059] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:54:14 2022] DELETE /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:54:14.427461 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-21906f1a-5b43-4fe7-87ad-015b783812f1 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:14.428099 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-21906f1a-5b43-4fe7-87ad-015b783812f1 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:14.437250 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-21906f1a-5b43-4fe7-87ad-015b783812f1 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:14.438031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-21906f1a-5b43-4fe7-87ad-015b783812f1 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:14.438771 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-21906f1a-5b43-4fe7-87ad-015b783812f1 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:14.440036 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-21906f1a-5b43-4fe7-87ad-015b783812f1 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:14.440694 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-21906f1a-5b43-4fe7-87ad-015b783812f1 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:14.441342 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-21906f1a-5b43-4fe7-87ad-015b783812f1 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:14.591630 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-21906f1a-5b43-4fe7-87ad-015b783812f1 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:54:14.604842 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-21906f1a-5b43-4fe7-87ad-015b783812f1 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 200 len: 1680 microversion: 2.1 time: 0.180416 Aug 22 05:54:14.606248 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 536/1060] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:14 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:54:15.638446 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0a4d95a3-f0e8-4357-9da4-0da888f45a94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:15.639638 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0a4d95a3-f0e8-4357-9da4-0da888f45a94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:15.650603 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a4d95a3-f0e8-4357-9da4-0da888f45a94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:15.651403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a4d95a3-f0e8-4357-9da4-0da888f45a94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:15.652285 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a4d95a3-f0e8-4357-9da4-0da888f45a94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:15.653417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a4d95a3-f0e8-4357-9da4-0da888f45a94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:15.654157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a4d95a3-f0e8-4357-9da4-0da888f45a94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:15.654853 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a4d95a3-f0e8-4357-9da4-0da888f45a94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:15.805666 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0a4d95a3-f0e8-4357-9da4-0da888f45a94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:54:15.817480 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0a4d95a3-f0e8-4357-9da4-0da888f45a94 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 200 len: 1680 microversion: 2.1 time: 0.185845 Aug 22 05:54:15.818277 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 525/1061] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:15 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:54:16.838429 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5c71800a-145d-490d-941a-0f4971179ad5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:16.839042 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5c71800a-145d-490d-941a-0f4971179ad5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:16.845979 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5c71800a-145d-490d-941a-0f4971179ad5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:16.846484 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5c71800a-145d-490d-941a-0f4971179ad5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:16.846909 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5c71800a-145d-490d-941a-0f4971179ad5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:16.847605 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5c71800a-145d-490d-941a-0f4971179ad5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:16.848082 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5c71800a-145d-490d-941a-0f4971179ad5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:16.848507 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5c71800a-145d-490d-941a-0f4971179ad5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:17.094871 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5c71800a-145d-490d-941a-0f4971179ad5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed76a574d2fc4bd8a1f1176d0fef86e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae948b0baa04f2eb07b2aee2785dcdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:54:17.103218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5c71800a-145d-490d-941a-0f4971179ad5 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 200 len: 1680 microversion: 2.1 time: 0.268635 Aug 22 05:54:17.103785 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 537/1062] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:16 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 1680 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:54:17.308875 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-9d499c08-2565-458f-96f8-fbcc5a04a554 req-250e16dc-2e25-4eeb-918c-3e2cfd0d0edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42a251a1-daba-4a3b-b499-d2e708b254c2", "name": "network-vif-deleted", "tag": "dd5e252c-6929-4072-860f-8adc45551b9b"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:54:17.322845 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-9d499c08-2565-458f-96f8-fbcc5a04a554 req-250e16dc-2e25-4eeb-918c-3e2cfd0d0edd service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:17.323767 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-9d499c08-2565-458f-96f8-fbcc5a04a554 req-250e16dc-2e25-4eeb-918c-3e2cfd0d0edd service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:17.324419 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-9d499c08-2565-458f-96f8-fbcc5a04a554 req-250e16dc-2e25-4eeb-918c-3e2cfd0d0edd service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:17.338940 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-9d499c08-2565-458f-96f8-fbcc5a04a554 req-250e16dc-2e25-4eeb-918c-3e2cfd0d0edd service nova] Creating event network-vif-deleted:dd5e252c-6929-4072-860f-8adc45551b9b for instance 42a251a1-daba-4a3b-b499-d2e708b254c2 on hv-cinder-85391 Aug 22 05:54:17.344753 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-9d499c08-2565-458f-96f8-fbcc5a04a554 req-250e16dc-2e25-4eeb-918c-3e2cfd0d0edd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039877 Aug 22 05:54:17.345588 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 526/1063] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:54:18.125809 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7bf8b50d-da9e-4fde-909c-85031879ca90 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:18.126419 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-7bf8b50d-da9e-4fde-909c-85031879ca90 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:18.135250 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7bf8b50d-da9e-4fde-909c-85031879ca90 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:18.135914 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7bf8b50d-da9e-4fde-909c-85031879ca90 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:18.136361 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7bf8b50d-da9e-4fde-909c-85031879ca90 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:18.137121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7bf8b50d-da9e-4fde-909c-85031879ca90 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:18.137578 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7bf8b50d-da9e-4fde-909c-85031879ca90 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:18.137980 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7bf8b50d-da9e-4fde-909c-85031879ca90 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:18.154112 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-7bf8b50d-da9e-4fde-909c-85031879ca90 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] HTTP exception thrown: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7bf8b50d-da9e-4fde-909c-85031879ca90 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Request method failure captured: Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 HTTP/1.1 Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxiB0Gr4ALACYYqYuigC9S-TnfoLV67-YFQv-bpD8zW-bDZ5brcwg_NF6SPJrEY2yLZrbM8eHzVA5EEKj_L3SbP1PonBqgPsCBCGVlsGI0AQRHWXA0g7rqTVBIjxgNMSn_JGuq8vEJ6-qXLyAhNXmm9NFNkofHNPMmDB_TukKpKz6K8 Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:54:18.155865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:54:18.157737 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fae948b0baa04f2eb07b2aee2785dcdd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:54:18.157737 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:18.157737 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:18.157737 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:18.157737 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:18.157737 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:54:18.157737 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:54:18.157737 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: ed76a574d2fc4bd8a1f1176d0fef86e2 Aug 22 05:54:18.157737 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:18.157737 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:54:18.157737 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. Aug 22 05:54:18.157737 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': '42a251a1-daba-4a3b-b499-d2e708b254c2'} Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:54:18.158678 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. Aug 22 05:54:18.160379 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:18.161736 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7bf8b50d-da9e-4fde-909c-85031879ca90 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Returning 404 to user: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:54:18.161736 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-7bf8b50d-da9e-4fde-909c-85031879ca90 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 404 len: 111 microversion: 2.1 time: 0.035719 Aug 22 05:54:18.161736 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 538/1064] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:18 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:54:18.169238 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-83fdccc6-5516-43f5-ae63-bd410cf6f754 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '.version_select at 0x7f0b3deb8430>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:18.192984 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-83fdccc6-5516-43f5-ae63-bd410cf6f754 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-201567347" status: 202 len: 0 microversion: 2.1 time: 0.029839 Aug 22 05:54:18.193601 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 527/1065] 10.222.0.18 () {58 vars in 1218 bytes} [Mon Aug 22 05:54:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-201567347 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:54:19.993950 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-cc75b54e-d06f-4806-aaac-4934501590fe tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:19.994503 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-cc75b54e-d06f-4806-aaac-4934501590fe tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:20.001211 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cc75b54e-d06f-4806-aaac-4934501590fe tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:20.001681 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cc75b54e-d06f-4806-aaac-4934501590fe tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:20.002104 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cc75b54e-d06f-4806-aaac-4934501590fe tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:20.002777 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cc75b54e-d06f-4806-aaac-4934501590fe tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:20.003215 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cc75b54e-d06f-4806-aaac-4934501590fe tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:20.003651 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-cc75b54e-d06f-4806-aaac-4934501590fe tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:20.017314 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-cc75b54e-d06f-4806-aaac-4934501590fe tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] HTTP exception thrown: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-cc75b54e-d06f-4806-aaac-4934501590fe tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Request method failure captured: Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: DELETE /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 HTTP/1.1 Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxiB0Gr4ALACYYqYuigC9S-TnfoLV67-YFQv-bpD8zW-bDZ5brcwg_NF6SPJrEY2yLZrbM8eHzVA5EEKj_L3SbP1PonBqgPsCBCGVlsGI0AQRHWXA0g7rqTVBIjxgNMSn_JGuq8vEJ6-qXLyAhNXmm9NFNkofHNPMmDB_TukKpKz6K8 Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:54:20.018847 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:54:20.020407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fae948b0baa04f2eb07b2aee2785dcdd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:54:20.020407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:20.020407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:20.020407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:20.020407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:20.020407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:54:20.020407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:54:20.020407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: ed76a574d2fc4bd8a1f1176d0fef86e2 Aug 22 05:54:20.020407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:20.020407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:54:20.020407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. Aug 22 05:54:20.020407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': '42a251a1-daba-4a3b-b499-d2e708b254c2'} Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:54:20.021326 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. Aug 22 05:54:20.023142 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:20.024838 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-cc75b54e-d06f-4806-aaac-4934501590fe tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Returning 404 to user: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:54:20.024838 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-cc75b54e-d06f-4806-aaac-4934501590fe tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "DELETE /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 404 len: 111 microversion: 2.1 time: 0.030284 Aug 22 05:54:20.024838 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 539/1066] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:54:19 2022] DELETE /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:54:20.029120 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a3d775f6-433a-4cab-85cb-4da852e42a67 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:20.029905 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a3d775f6-433a-4cab-85cb-4da852e42a67 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 42a251a1-daba-4a3b-b499-d2e708b254c2] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:20.037709 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3d775f6-433a-4cab-85cb-4da852e42a67 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:20.038359 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3d775f6-433a-4cab-85cb-4da852e42a67 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:20.038792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3d775f6-433a-4cab-85cb-4da852e42a67 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:20.039473 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3d775f6-433a-4cab-85cb-4da852e42a67 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:20.039950 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3d775f6-433a-4cab-85cb-4da852e42a67 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:20.040365 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3d775f6-433a-4cab-85cb-4da852e42a67 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:20.053673 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-a3d775f6-433a-4cab-85cb-4da852e42a67 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] HTTP exception thrown: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a3d775f6-433a-4cab-85cb-4da852e42a67 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Request method failure captured: Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 HTTP/1.1 Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxiB0Gr4ALACYYqYuigC9S-TnfoLV67-YFQv-bpD8zW-bDZ5brcwg_NF6SPJrEY2yLZrbM8eHzVA5EEKj_L3SbP1PonBqgPsCBCGVlsGI0AQRHWXA0g7rqTVBIjxgNMSn_JGuq8vEJ6-qXLyAhNXmm9NFNkofHNPMmDB_TukKpKz6K8 Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:54:20.055299 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:54:20.057034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fae948b0baa04f2eb07b2aee2785dcdd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:54:20.057034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:20.057034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:20.057034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:20.057034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:20.057034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:54:20.057034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:54:20.057034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: ed76a574d2fc4bd8a1f1176d0fef86e2 Aug 22 05:54:20.057034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:20.057034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:54:20.057034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. Aug 22 05:54:20.057034 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '42a251a1-daba-4a3b-b499-d2e708b254c2'} Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:54:20.058016 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. Aug 22 05:54:20.059470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:20.060905 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a3d775f6-433a-4cab-85cb-4da852e42a67 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Returning 404 to user: Instance 42a251a1-daba-4a3b-b499-d2e708b254c2 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:54:20.060905 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a3d775f6-433a-4cab-85cb-4da852e42a67 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2" status: 404 len: 111 microversion: 2.1 time: 0.031597 Aug 22 05:54:20.060905 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 528/1067] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:20 2022] GET /compute/v2.1/servers/42a251a1-daba-4a3b-b499-d2e708b254c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:54:21.201805 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5aff3fda-84cf-4756-8789-8e8c3d001403 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:21.202329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5aff3fda-84cf-4756-8789-8e8c3d001403 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:21.209114 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5aff3fda-84cf-4756-8789-8e8c3d001403 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:21.209587 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5aff3fda-84cf-4756-8789-8e8c3d001403 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:21.210012 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5aff3fda-84cf-4756-8789-8e8c3d001403 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:21.210921 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5aff3fda-84cf-4756-8789-8e8c3d001403 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:21.211368 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5aff3fda-84cf-4756-8789-8e8c3d001403 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:21.211828 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5aff3fda-84cf-4756-8789-8e8c3d001403 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:21.225845 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-5aff3fda-84cf-4756-8789-8e8c3d001403 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] HTTP exception thrown: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5aff3fda-84cf-4756-8789-8e8c3d001403 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Request method failure captured: Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: DELETE /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 HTTP/1.1 Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxiB0Gr4ALACYYqYuigC9S-TnfoLV67-YFQv-bpD8zW-bDZ5brcwg_NF6SPJrEY2yLZrbM8eHzVA5EEKj_L3SbP1PonBqgPsCBCGVlsGI0AQRHWXA0g7rqTVBIjxgNMSn_JGuq8vEJ6-qXLyAhNXmm9NFNkofHNPMmDB_TukKpKz6K8 Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:54:21.227381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:54:21.229049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fae948b0baa04f2eb07b2aee2785dcdd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:54:21.229049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:21.229049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:21.229049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:21.229049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:21.229049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:54:21.229049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:54:21.229049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: ed76a574d2fc4bd8a1f1176d0fef86e2 Aug 22 05:54:21.229049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:21.229049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:54:21.229049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. Aug 22 05:54:21.229049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': 'a56118cf-1cde-4a07-be0e-7140d0138290'} Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:54:21.230158 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. Aug 22 05:54:21.231704 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.233360 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5aff3fda-84cf-4756-8789-8e8c3d001403 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Returning 404 to user: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:54:21.233360 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5aff3fda-84cf-4756-8789-8e8c3d001403 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 404 len: 111 microversion: 2.1 time: 0.030896 Aug 22 05:54:21.233360 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 540/1068] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:54:21 2022] DELETE /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:54:21.237393 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4bf0ebf5-1088-45d1-8ed9-8886b3f03acf tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:21.238000 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4bf0ebf5-1088-45d1-8ed9-8886b3f03acf tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: a56118cf-1cde-4a07-be0e-7140d0138290] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:21.244681 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bf0ebf5-1088-45d1-8ed9-8886b3f03acf tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:21.245146 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bf0ebf5-1088-45d1-8ed9-8886b3f03acf tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:21.245591 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bf0ebf5-1088-45d1-8ed9-8886b3f03acf tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:21.246268 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bf0ebf5-1088-45d1-8ed9-8886b3f03acf tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:21.246715 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bf0ebf5-1088-45d1-8ed9-8886b3f03acf tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:21.247129 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bf0ebf5-1088-45d1-8ed9-8886b3f03acf tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:21.260530 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-4bf0ebf5-1088-45d1-8ed9-8886b3f03acf tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] HTTP exception thrown: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4bf0ebf5-1088-45d1-8ed9-8886b3f03acf tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Request method failure captured: Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 HTTP/1.1 Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxiB0Gr4ALACYYqYuigC9S-TnfoLV67-YFQv-bpD8zW-bDZ5brcwg_NF6SPJrEY2yLZrbM8eHzVA5EEKj_L3SbP1PonBqgPsCBCGVlsGI0AQRHWXA0g7rqTVBIjxgNMSn_JGuq8vEJ6-qXLyAhNXmm9NFNkofHNPMmDB_TukKpKz6K8 Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:54:21.262062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:54:21.263758 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fae948b0baa04f2eb07b2aee2785dcdd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:54:21.263758 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:21.263758 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:21.263758 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:21.263758 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:21.263758 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:54:21.263758 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:54:21.263758 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: ed76a574d2fc4bd8a1f1176d0fef86e2 Aug 22 05:54:21.263758 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:21.263758 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:54:21.263758 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. Aug 22 05:54:21.263758 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': 'a56118cf-1cde-4a07-be0e-7140d0138290'} Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:54:21.264598 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. Aug 22 05:54:21.266079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.267357 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4bf0ebf5-1088-45d1-8ed9-8886b3f03acf tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Returning 404 to user: Instance a56118cf-1cde-4a07-be0e-7140d0138290 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:54:21.267357 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4bf0ebf5-1088-45d1-8ed9-8886b3f03acf tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290" status: 404 len: 111 microversion: 2.1 time: 0.029968 Aug 22 05:54:21.267357 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 529/1069] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:21 2022] GET /compute/v2.1/servers/a56118cf-1cde-4a07-be0e-7140d0138290 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:54:21.271866 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-aaece68e-f4bb-4a87-b61e-96d809877cfd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:21.272355 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-aaece68e-f4bb-4a87-b61e-96d809877cfd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:21.278643 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aaece68e-f4bb-4a87-b61e-96d809877cfd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:21.279107 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aaece68e-f4bb-4a87-b61e-96d809877cfd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:21.279696 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aaece68e-f4bb-4a87-b61e-96d809877cfd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:21.280361 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aaece68e-f4bb-4a87-b61e-96d809877cfd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:21.280804 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aaece68e-f4bb-4a87-b61e-96d809877cfd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:21.281212 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-aaece68e-f4bb-4a87-b61e-96d809877cfd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:21.294614 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-aaece68e-f4bb-4a87-b61e-96d809877cfd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] HTTP exception thrown: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-aaece68e-f4bb-4a87-b61e-96d809877cfd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Request method failure captured: Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: DELETE /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e HTTP/1.1 Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxiB0Gr4ALACYYqYuigC9S-TnfoLV67-YFQv-bpD8zW-bDZ5brcwg_NF6SPJrEY2yLZrbM8eHzVA5EEKj_L3SbP1PonBqgPsCBCGVlsGI0AQRHWXA0g7rqTVBIjxgNMSn_JGuq8vEJ6-qXLyAhNXmm9NFNkofHNPMmDB_TukKpKz6K8 Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:54:21.296196 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:54:21.297778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fae948b0baa04f2eb07b2aee2785dcdd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:54:21.297778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:21.297778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:21.297778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:21.297778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:21.297778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:54:21.297778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:54:21.297778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: ed76a574d2fc4bd8a1f1176d0fef86e2 Aug 22 05:54:21.297778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:21.297778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:54:21.297778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. Aug 22 05:54:21.297778 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': '38c74c55-3079-4099-9b60-2146b6ad9e5e'} Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:54:21.298725 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. Aug 22 05:54:21.300370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.301818 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-aaece68e-f4bb-4a87-b61e-96d809877cfd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Returning 404 to user: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:54:21.301818 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-aaece68e-f4bb-4a87-b61e-96d809877cfd tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "DELETE /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 404 len: 111 microversion: 2.1 time: 0.029509 Aug 22 05:54:21.301818 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 541/1070] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:54:21 2022] DELETE /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:54:21.306428 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7f070029-89b0-4d06-b471-9b2d9a459b73 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:21.307040 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7f070029-89b0-4d06-b471-9b2d9a459b73 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 38c74c55-3079-4099-9b60-2146b6ad9e5e] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:21.313522 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f070029-89b0-4d06-b471-9b2d9a459b73 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:21.314000 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f070029-89b0-4d06-b471-9b2d9a459b73 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:21.314426 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f070029-89b0-4d06-b471-9b2d9a459b73 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:21.315109 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f070029-89b0-4d06-b471-9b2d9a459b73 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:21.315551 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f070029-89b0-4d06-b471-9b2d9a459b73 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:21.316035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7f070029-89b0-4d06-b471-9b2d9a459b73 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:21.329455 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-7f070029-89b0-4d06-b471-9b2d9a459b73 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] HTTP exception thrown: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7f070029-89b0-4d06-b471-9b2d9a459b73 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Request method failure captured: Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e HTTP/1.1 Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxiB0Gr4ALACYYqYuigC9S-TnfoLV67-YFQv-bpD8zW-bDZ5brcwg_NF6SPJrEY2yLZrbM8eHzVA5EEKj_L3SbP1PonBqgPsCBCGVlsGI0AQRHWXA0g7rqTVBIjxgNMSn_JGuq8vEJ6-qXLyAhNXmm9NFNkofHNPMmDB_TukKpKz6K8 Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:54:21.330979 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:54:21.332698 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fae948b0baa04f2eb07b2aee2785dcdd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:54:21.332698 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:21.332698 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:21.332698 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:21.332698 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:21.332698 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:54:21.332698 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:54:21.332698 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: ed76a574d2fc4bd8a1f1176d0fef86e2 Aug 22 05:54:21.332698 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:21.332698 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:54:21.332698 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. Aug 22 05:54:21.332698 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '38c74c55-3079-4099-9b60-2146b6ad9e5e'} Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:54:21.333594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. Aug 22 05:54:21.335097 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:21.336713 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7f070029-89b0-4d06-b471-9b2d9a459b73 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Returning 404 to user: Instance 38c74c55-3079-4099-9b60-2146b6ad9e5e could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:54:21.336713 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7f070029-89b0-4d06-b471-9b2d9a459b73 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e" status: 404 len: 111 microversion: 2.1 time: 0.030111 Aug 22 05:54:21.336713 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 530/1071] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:21 2022] GET /compute/v2.1/servers/38c74c55-3079-4099-9b60-2146b6ad9e5e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:54:22.492767 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6e4d0f05-6362-457e-bec4-22495b42a3c9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:22.493283 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-6e4d0f05-6362-457e-bec4-22495b42a3c9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:22.502495 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6e4d0f05-6362-457e-bec4-22495b42a3c9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:22.503074 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6e4d0f05-6362-457e-bec4-22495b42a3c9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:22.503761 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6e4d0f05-6362-457e-bec4-22495b42a3c9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:22.504806 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6e4d0f05-6362-457e-bec4-22495b42a3c9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:22.505442 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6e4d0f05-6362-457e-bec4-22495b42a3c9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:22.505958 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6e4d0f05-6362-457e-bec4-22495b42a3c9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:22.520577 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-6e4d0f05-6362-457e-bec4-22495b42a3c9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] HTTP exception thrown: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6e4d0f05-6362-457e-bec4-22495b42a3c9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Request method failure captured: Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: DELETE /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 HTTP/1.1 Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxiB0Gr4ALACYYqYuigC9S-TnfoLV67-YFQv-bpD8zW-bDZ5brcwg_NF6SPJrEY2yLZrbM8eHzVA5EEKj_L3SbP1PonBqgPsCBCGVlsGI0AQRHWXA0g7rqTVBIjxgNMSn_JGuq8vEJ6-qXLyAhNXmm9NFNkofHNPMmDB_TukKpKz6K8 Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:54:22.522121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:54:22.523746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fae948b0baa04f2eb07b2aee2785dcdd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:54:22.523746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:22.523746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:22.523746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:22.523746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:22.523746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:54:22.523746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:54:22.523746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: ed76a574d2fc4bd8a1f1176d0fef86e2 Aug 22 05:54:22.523746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:22.523746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:54:22.523746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. Aug 22 05:54:22.523746 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': '3a8c0835-e37b-42f9-99f6-be6465184333'} Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:54:22.525165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. Aug 22 05:54:22.526713 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:22.528516 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6e4d0f05-6362-457e-bec4-22495b42a3c9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Returning 404 to user: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:54:22.528516 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6e4d0f05-6362-457e-bec4-22495b42a3c9 tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 404 len: 111 microversion: 2.1 time: 0.037820 Aug 22 05:54:22.528516 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 542/1072] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:54:22 2022] DELETE /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:54:22.531988 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1365d505-2e1b-4644-968e-bfb66bd7fede tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:22.532595 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1365d505-2e1b-4644-968e-bfb66bd7fede tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] [instance: 3a8c0835-e37b-42f9-99f6-be6465184333] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:22.539222 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1365d505-2e1b-4644-968e-bfb66bd7fede tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:22.539730 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1365d505-2e1b-4644-968e-bfb66bd7fede tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:22.540480 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1365d505-2e1b-4644-968e-bfb66bd7fede tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:22.540904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1365d505-2e1b-4644-968e-bfb66bd7fede tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:22.541352 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1365d505-2e1b-4644-968e-bfb66bd7fede tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:22.541740 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1365d505-2e1b-4644-968e-bfb66bd7fede tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:22.556237 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-1365d505-2e1b-4644-968e-bfb66bd7fede tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] HTTP exception thrown: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1365d505-2e1b-4644-968e-bfb66bd7fede tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Request method failure captured: Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 HTTP/1.1 Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxiB0Gr4ALACYYqYuigC9S-TnfoLV67-YFQv-bpD8zW-bDZ5brcwg_NF6SPJrEY2yLZrbM8eHzVA5EEKj_L3SbP1PonBqgPsCBCGVlsGI0AQRHWXA0g7rqTVBIjxgNMSn_JGuq8vEJ6-qXLyAhNXmm9NFNkofHNPMmDB_TukKpKz6K8 Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:54:22.557773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:54:22.560072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fae948b0baa04f2eb07b2aee2785dcdd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fae948b0baa04f2eb07b2aee2785dcdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:54:22.560072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:22.560072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: fae948b0baa04f2eb07b2aee2785dcdd Aug 22 05:54:22.560072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172535368 Aug 22 05:54:22.560072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:22.560072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:54:22.560072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:54:22.560072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: ed76a574d2fc4bd8a1f1176d0fef86e2 Aug 22 05:54:22.560072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeNegativeTest-172535368-project Aug 22 05:54:22.560072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:54:22.560072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. Aug 22 05:54:22.560072 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '3a8c0835-e37b-42f9-99f6-be6465184333'} Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:54:22.560898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. Aug 22 05:54:22.562138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:22.563240 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1365d505-2e1b-4644-968e-bfb66bd7fede tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] Returning 404 to user: Instance 3a8c0835-e37b-42f9-99f6-be6465184333 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:54:22.563240 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1365d505-2e1b-4644-968e-bfb66bd7fede tempest-AttachVolumeNegativeTest-172535368 tempest-AttachVolumeNegativeTest-172535368-project] 10.222.0.18 "GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333" status: 404 len: 111 microversion: 2.1 time: 0.031024 Aug 22 05:54:22.563240 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 531/1073] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:22 2022] GET /compute/v2.1/servers/3a8c0835-e37b-42f9-99f6-be6465184333 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:54:27.019529 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c4a1e875-b172-4af1-83a0-2e229fb17e1c tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Action: 'create', calling method: .version_select at 0x7f0b428321f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1349256466", "metadata": {"Type": "work"}}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c4a1e875-b172-4af1-83a0-2e229fb17e1c tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Request method failure captured: Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 122 Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxoS4XRF1jLeQu5EsJo6hmKlY1I1VK0JO6v8XHyrdr6ZXDZx-MJ4J2I_Qa5RUe_zKKr30sRru_6iVOQ47J0avwSkpp05LRz8UlNIUPnzTEUZipdIBKEcanO0BNwAaZMkARRseoGr4ccJY1P2fZ5-L3JS8IVNmxoj64bxvEVTRBwpqJg Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: 53eb4064d1184408b94fdc08bb5aa359 Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:54:27.040882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:54:27.043492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53eb4064d1184408b94fdc08bb5aa359", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:54:27.043492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.043492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: 53eb4064d1184408b94fdc08bb5aa359 Aug 22 05:54:27.043492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.043492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-VolumesNegativeTest-436016570-project Aug 22 05:54:27.043492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:54:27.043492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:54:27.043492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: 5c9dac0290b44af9bad13536d7383aa9 Aug 22 05:54:27.043492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-VolumesNegativeTest-436016570-project Aug 22 05:54:27.043492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Aug 22 05:54:27.043492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1349256466", "metadata": {"Type": "work"}}} Aug 22 05:54:27.043492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: Aug 22 05:54:27.043492 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1349256466', 'metadata': {'Type': 'work'}}}} Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise error Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi '#$%' Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:54:27.045874 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 05:54:27.050020 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 05:54:27.053380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 05:54:27.053380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.053380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c4a1e875-b172-4af1-83a0-2e229fb17e1c tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:54:27.053380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c4a1e875-b172-4af1-83a0-2e229fb17e1c tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.154199 Aug 22 05:54:27.053380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 543/1074] 10.222.0.18 () {60 vars in 1156 bytes} [Mon Aug 22 05:54:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 05:54:27.059451 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1a7f7724-8f67-469f-96d5-7cfd0d2a5363 tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Action: 'create', calling method: .version_select at 0x7f0b3dda3550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-835872871", "metadata": {"Type": "work"}}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1a7f7724-8f67-469f-96d5-7cfd0d2a5363 tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Request method failure captured: Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 119 Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxoS4XRF1jLeQu5EsJo6hmKlY1I1VK0JO6v8XHyrdr6ZXDZx-MJ4J2I_Qa5RUe_zKKr30sRru_6iVOQ47J0avwSkpp05LRz8UlNIUPnzTEUZipdIBKEcanO0BNwAaZMkARRseoGr4ccJY1P2fZ5-L3JS8IVNmxoj64bxvEVTRBwpqJg Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 53eb4064d1184408b94fdc08bb5aa359 Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:54:27.064082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:54:27.065677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53eb4064d1184408b94fdc08bb5aa359", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:54:27.065677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.065677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 53eb4064d1184408b94fdc08bb5aa359 Aug 22 05:54:27.065677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.065677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesNegativeTest-436016570-project Aug 22 05:54:27.065677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:54:27.065677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:54:27.065677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 5c9dac0290b44af9bad13536d7383aa9 Aug 22 05:54:27.065677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesNegativeTest-436016570-project Aug 22 05:54:27.065677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Aug 22 05:54:27.065677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-835872871", "metadata": {"Type": "work"}}} Aug 22 05:54:27.065677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: Aug 22 05:54:27.065677 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-835872871', 'metadata': {'Type': 'work'}}}} Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise error Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi '0' Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:54:27.066654 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 05:54:27.068278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 05:54:27.069707 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 05:54:27.069707 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.069707 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1a7f7724-8f67-469f-96d5-7cfd0d2a5363 tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:54:27.069707 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1a7f7724-8f67-469f-96d5-7cfd0d2a5363 tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011429 Aug 22 05:54:27.069707 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 532/1075] 10.222.0.18 () {60 vars in 1156 bytes} [Mon Aug 22 05:54:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 05:54:27.074845 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-851fd7d6-729b-4f6c-b255-ebd20d68d424 tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Action: 'create', calling method: .version_select at 0x7f0b3df3db80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-546672402", "metadata": {"Type": "work"}}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-851fd7d6-729b-4f6c-b255-ebd20d68d424 tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Request method failure captured: Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 118 Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxoS4XRF1jLeQu5EsJo6hmKlY1I1VK0JO6v8XHyrdr6ZXDZx-MJ4J2I_Qa5RUe_zKKr30sRru_6iVOQ47J0avwSkpp05LRz8UlNIUPnzTEUZipdIBKEcanO0BNwAaZMkARRseoGr4ccJY1P2fZ5-L3JS8IVNmxoj64bxvEVTRBwpqJg Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: 53eb4064d1184408b94fdc08bb5aa359 Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:54:27.080607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:54:27.082152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53eb4064d1184408b94fdc08bb5aa359", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:54:27.082152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.082152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: 53eb4064d1184408b94fdc08bb5aa359 Aug 22 05:54:27.082152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.082152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-VolumesNegativeTest-436016570-project Aug 22 05:54:27.082152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:54:27.082152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:54:27.082152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: 5c9dac0290b44af9bad13536d7383aa9 Aug 22 05:54:27.082152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-VolumesNegativeTest-436016570-project Aug 22 05:54:27.082152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Aug 22 05:54:27.082152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-546672402", "metadata": {"Type": "work"}}} Aug 22 05:54:27.082152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: Aug 22 05:54:27.082152 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-546672402', 'metadata': {'Type': 'work'}}}} Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise error Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi '' Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:54:27.083125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 05:54:27.084726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 05:54:27.086143 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 05:54:27.086143 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.086143 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-851fd7d6-729b-4f6c-b255-ebd20d68d424 tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:54:27.086143 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-851fd7d6-729b-4f6c-b255-ebd20d68d424 tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011138 Aug 22 05:54:27.086143 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 544/1076] 10.222.0.18 () {60 vars in 1156 bytes} [Mon Aug 22 05:54:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 22 05:54:27.092566 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b72fde03-38ba-470a-8368-1da8d2b63d5c tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Calling method '.version_select at 0x7f0b3dd64a60>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:27.124688 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-b72fde03-38ba-470a-8368-1da8d2b63d5c tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] HTTP exception thrown: Volume tempest-invalid-249033380 could not be found. Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b72fde03-38ba-470a-8368-1da8d2b63d5c tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Request method failure captured: Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-249033380 HTTP/1.1 Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxoS4XRF1jLeQu5EsJo6hmKlY1I1VK0JO6v8XHyrdr6ZXDZx-MJ4J2I_Qa5RUe_zKKr30sRru_6iVOQ47J0avwSkpp05LRz8UlNIUPnzTEUZipdIBKEcanO0BNwAaZMkARRseoGr4ccJY1P2fZ5-L3JS8IVNmxoj64bxvEVTRBwpqJg Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 53eb4064d1184408b94fdc08bb5aa359 Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:54:27.126711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:54:27.128381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53eb4064d1184408b94fdc08bb5aa359", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:54:27.128381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.128381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 53eb4064d1184408b94fdc08bb5aa359 Aug 22 05:54:27.128381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.128381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesNegativeTest-436016570-project Aug 22 05:54:27.128381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:54:27.128381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:54:27.128381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 5c9dac0290b44af9bad13536d7383aa9 Aug 22 05:54:27.128381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesNegativeTest-436016570-project Aug 22 05:54:27.128381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: Aug 22 05:54:27.128381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Volume tempest-invalid-249033380 could not be found. Aug 22 05:54:27.128381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': 'tempest-invalid-249033380'} Aug 22 05:54:27.128381 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-249033380 could not be found. (HTTP 404) (Request-ID: req-cdde1bdd-6c38-45b1-81de-9f1a4df0d517) Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:27.129376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 05:54:27.131005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-249033380 could not be found. Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:54:27.132496 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-249033380 could not be found. Aug 22 05:54:27.133943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.133943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:27.133943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.133943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.133943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:27.133943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:27.133943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:54:27.133943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:54:27.133943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-249033380 could not be found. Aug 22 05:54:27.133943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.133943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b72fde03-38ba-470a-8368-1da8d2b63d5c tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Returning 404 to user: Volume tempest-invalid-249033380 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:54:27.133943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b72fde03-38ba-470a-8368-1da8d2b63d5c tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-249033380" status: 404 len: 98 microversion: 2.1 time: 0.040774 Aug 22 05:54:27.133943 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 533/1077] 10.222.0.18 () {58 vars in 1215 bytes} [Mon Aug 22 05:54:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-249033380 => generated 98 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 05:54:27.138438 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-177e2e81-e6d0-499d-8756-701c700f36e0 tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004272 Aug 22 05:54:27.138920 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 545/1078] 10.222.0.18 () {58 vars in 1140 bytes} [Mon Aug 22 05:54:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 22 05:54:27.147720 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8912d761-31ab-4bf5-b5aa-1431f190d2ad tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003778 Aug 22 05:54:27.148044 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 534/1079] 10.222.0.18 () {58 vars in 1137 bytes} [Mon Aug 22 05:54:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 22 05:54:27.158842 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4fa952f2-075d-4ae8-a11a-04d4e3f73e9c tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Calling method '.version_select at 0x7f0b426e2b80>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:27.194792 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-4fa952f2-075d-4ae8-a11a-04d4e3f73e9c tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] HTTP exception thrown: Volume 301453aa-61c4-4eda-8da8-94cef97aa541 could not be found. Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4fa952f2-075d-4ae8-a11a-04d4e3f73e9c tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Request method failure captured: Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: DELETE /compute/v2.1/os-volumes/301453aa-61c4-4eda-8da8-94cef97aa541 HTTP/1.1 Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxoS4XRF1jLeQu5EsJo6hmKlY1I1VK0JO6v8XHyrdr6ZXDZx-MJ4J2I_Qa5RUe_zKKr30sRru_6iVOQ47J0avwSkpp05LRz8UlNIUPnzTEUZipdIBKEcanO0BNwAaZMkARRseoGr4ccJY1P2fZ5-L3JS8IVNmxoj64bxvEVTRBwpqJg Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: 53eb4064d1184408b94fdc08bb5aa359 Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:54:27.196770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:54:27.198407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53eb4064d1184408b94fdc08bb5aa359", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:54:27.198407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.198407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: 53eb4064d1184408b94fdc08bb5aa359 Aug 22 05:54:27.198407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.198407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-VolumesNegativeTest-436016570-project Aug 22 05:54:27.198407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:54:27.198407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:54:27.198407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: 5c9dac0290b44af9bad13536d7383aa9 Aug 22 05:54:27.198407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-VolumesNegativeTest-436016570-project Aug 22 05:54:27.198407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: Aug 22 05:54:27.198407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Volume 301453aa-61c4-4eda-8da8-94cef97aa541 could not be found. Aug 22 05:54:27.198407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': '301453aa-61c4-4eda-8da8-94cef97aa541'} Aug 22 05:54:27.198407 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 301453aa-61c4-4eda-8da8-94cef97aa541 could not be found. (HTTP 404) (Request-ID: req-e9c6754b-6467-49c5-9c0f-90a9d7b63793) Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:27.199428 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 05:54:27.200665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 301453aa-61c4-4eda-8da8-94cef97aa541 could not be found. Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 05:54:27.201861 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:54:27.203183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 301453aa-61c4-4eda-8da8-94cef97aa541 could not be found. Aug 22 05:54:27.203183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.203183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:27.203183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.203183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.203183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:27.203183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:27.203183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:54:27.203183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:54:27.203183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 301453aa-61c4-4eda-8da8-94cef97aa541 could not be found. Aug 22 05:54:27.203183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.203183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-4fa952f2-075d-4ae8-a11a-04d4e3f73e9c tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Returning 404 to user: Volume 301453aa-61c4-4eda-8da8-94cef97aa541 could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:54:27.203183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-4fa952f2-075d-4ae8-a11a-04d4e3f73e9c tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/301453aa-61c4-4eda-8da8-94cef97aa541" status: 404 len: 109 microversion: 2.1 time: 0.045208 Aug 22 05:54:27.203183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 546/1080] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 22 05:54:27 2022] DELETE /compute/v2.1/os-volumes/301453aa-61c4-4eda-8da8-94cef97aa541 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:54:27.209411 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e25857d1-8be1-4960-8938-eb8e0aeac951 tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Calling method '.version_select at 0x7f0b3dedb3a0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:27.238033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-e25857d1-8be1-4960-8938-eb8e0aeac951 tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] HTTP exception thrown: Volume 85076f12-ff5f-43b1-935b-0951601a61a7 could not be found. Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e25857d1-8be1-4960-8938-eb8e0aeac951 tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Request method failure captured: Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/os-volumes/85076f12-ff5f-43b1-935b-0951601a61a7 HTTP/1.1 Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxoS4XRF1jLeQu5EsJo6hmKlY1I1VK0JO6v8XHyrdr6ZXDZx-MJ4J2I_Qa5RUe_zKKr30sRru_6iVOQ47J0avwSkpp05LRz8UlNIUPnzTEUZipdIBKEcanO0BNwAaZMkARRseoGr4ccJY1P2fZ5-L3JS8IVNmxoj64bxvEVTRBwpqJg Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 53eb4064d1184408b94fdc08bb5aa359 Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:54:27.240033 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:54:27.241671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53eb4064d1184408b94fdc08bb5aa359", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53eb4064d1184408b94fdc08bb5aa359"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:54:27.241671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.241671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 53eb4064d1184408b94fdc08bb5aa359 Aug 22 05:54:27.241671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesNegativeTest-436016570 Aug 22 05:54:27.241671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesNegativeTest-436016570-project Aug 22 05:54:27.241671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:54:27.241671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:54:27.241671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 5c9dac0290b44af9bad13536d7383aa9 Aug 22 05:54:27.241671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesNegativeTest-436016570-project Aug 22 05:54:27.241671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: Aug 22 05:54:27.241671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Volume 85076f12-ff5f-43b1-935b-0951601a61a7 could not be found. Aug 22 05:54:27.241671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '85076f12-ff5f-43b1-935b-0951601a61a7'} Aug 22 05:54:27.241671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85076f12-ff5f-43b1-935b-0951601a61a7 could not be found. (HTTP 404) (Request-ID: req-428f34a7-c884-45e2-ac13-b1d1341644c6) Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:27.242662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 05:54:27.244349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85076f12-ff5f-43b1-935b-0951601a61a7 could not be found. Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 05:54:27.245650 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:54:27.247157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85076f12-ff5f-43b1-935b-0951601a61a7 could not be found. Aug 22 05:54:27.247157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.247157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:54:27.247157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.247157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:54:27.247157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:54:27.247157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:54:27.247157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:54:27.247157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:54:27.247157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85076f12-ff5f-43b1-935b-0951601a61a7 could not be found. Aug 22 05:54:27.247157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:54:27.247157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e25857d1-8be1-4960-8938-eb8e0aeac951 tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] Returning 404 to user: Volume 85076f12-ff5f-43b1-935b-0951601a61a7 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:54:27.247157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e25857d1-8be1-4960-8938-eb8e0aeac951 tempest-VolumesNegativeTest-436016570 tempest-VolumesNegativeTest-436016570-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/85076f12-ff5f-43b1-935b-0951601a61a7" status: 404 len: 109 microversion: 2.1 time: 0.035913 Aug 22 05:54:27.247157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 535/1081] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 22 05:54:27 2022] GET /compute/v2.1/os-volumes/85076f12-ff5f-43b1-935b-0951601a61a7 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:54:46.689293 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=20 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:46.690058 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:46.694878 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1971020987", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452", "networks": [{"uuid": "35c35c8f-c4a7-40e9-820d-7cf08fe1d173"}]}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:54:46.753591 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.network.neutron [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] validate_networks() for [('35c35c8f-c4a7-40e9-820d-7cf08fe1d173', None, None, None, None, None)] {{(pid=132497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:54:47.176833 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Flavor limits 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:54:47.177363 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Image limits 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:54:47.178054 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Flavor pref 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:54:47.178605 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Image pref 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:54:47.179163 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:54:47.192820 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:47.193297 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:47.193727 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:47.194447 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:47.194896 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:47.195314 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:47.213547 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Getting quotas for project a50845ada6944e769765e36f978ca716. Resources: {'cores', 'instances', 'ram'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:54:47.218307 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Getting quotas for user a821e4dcde67481bb33c574ac5973fd9 and project a50845ada6944e769765e36f978ca716. Resources: {'cores', 'instances', 'ram'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:54:47.231216 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Going to run 1 instances... {{(pid=132497) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:54:47.233556 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:54:47.281471 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-1b24bd04-2f61-4564-b818-a2ded07fbd2d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593534 Aug 22 05:54:47.282121 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 547/1082] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:54:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:54:47.291699 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:47.292667 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:47.297270 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c939b8d8-98e4-410c-9cfc-034dceaea19d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:47.297991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c939b8d8-98e4-410c-9cfc-034dceaea19d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:47.356067 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c939b8d8-98e4-410c-9cfc-034dceaea19d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:54:47.363554 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c939b8d8-98e4-410c-9cfc-034dceaea19d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb" status: 200 len: 1219 microversion: 2.1 time: 0.074090 Aug 22 05:54:47.364198 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 536/1083] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:47 2022] GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:54:48.385009 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-dc7e0e3c-e4e5-455c-bb51-5a450bc325fd tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:48.386487 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-dc7e0e3c-e4e5-455c-bb51-5a450bc325fd tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:48.394454 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc7e0e3c-e4e5-455c-bb51-5a450bc325fd tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:48.395109 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc7e0e3c-e4e5-455c-bb51-5a450bc325fd tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:48.395871 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc7e0e3c-e4e5-455c-bb51-5a450bc325fd tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:48.396770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc7e0e3c-e4e5-455c-bb51-5a450bc325fd tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:48.397207 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc7e0e3c-e4e5-455c-bb51-5a450bc325fd tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:48.397867 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-dc7e0e3c-e4e5-455c-bb51-5a450bc325fd tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:48.493460 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-dc7e0e3c-e4e5-455c-bb51-5a450bc325fd tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:54:48.502877 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-dc7e0e3c-e4e5-455c-bb51-5a450bc325fd tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb" status: 200 len: 1279 microversion: 2.1 time: 0.122267 Aug 22 05:54:48.503444 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 548/1084] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:48 2022] GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb => generated 1279 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:54:49.524080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1eba1c4c-d0b7-47c1-8b51-9a1fec170577 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:49.524766 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1eba1c4c-d0b7-47c1-8b51-9a1fec170577 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:49.531520 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1eba1c4c-d0b7-47c1-8b51-9a1fec170577 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:49.532101 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1eba1c4c-d0b7-47c1-8b51-9a1fec170577 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:49.532595 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1eba1c4c-d0b7-47c1-8b51-9a1fec170577 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:49.533451 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1eba1c4c-d0b7-47c1-8b51-9a1fec170577 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:49.534204 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1eba1c4c-d0b7-47c1-8b51-9a1fec170577 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:49.534646 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1eba1c4c-d0b7-47c1-8b51-9a1fec170577 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:49.727062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1eba1c4c-d0b7-47c1-8b51-9a1fec170577 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:54:49.735475 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1eba1c4c-d0b7-47c1-8b51-9a1fec170577 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb" status: 200 len: 1319 microversion: 2.1 time: 0.215332 Aug 22 05:54:49.736172 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 537/1085] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:49 2022] GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:54:49.810649 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-b2ec990f-5bc1-4499-9301-b2de6a2af023 req-c96def51-4b3a-42ba-893f-3040e44fc5dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c3b1871-8ccf-4adc-8cd6-593ba642c6cb", "tag": "99335786-0aa5-4b90-a360-6c9a6948905f"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:54:49.821679 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b2ec990f-5bc1-4499-9301-b2de6a2af023 req-c96def51-4b3a-42ba-893f-3040e44fc5dd service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:49.822394 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b2ec990f-5bc1-4499-9301-b2de6a2af023 req-c96def51-4b3a-42ba-893f-3040e44fc5dd service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:49.822988 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b2ec990f-5bc1-4499-9301-b2de6a2af023 req-c96def51-4b3a-42ba-893f-3040e44fc5dd service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:49.835011 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-b2ec990f-5bc1-4499-9301-b2de6a2af023 req-c96def51-4b3a-42ba-893f-3040e44fc5dd service nova] Creating event network-changed:99335786-0aa5-4b90-a360-6c9a6948905f for instance 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb on hv-cinder-85391 Aug 22 05:54:49.840305 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-b2ec990f-5bc1-4499-9301-b2de6a2af023 req-c96def51-4b3a-42ba-893f-3040e44fc5dd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033679 Aug 22 05:54:49.840909 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 549/1086] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:54:50.757623 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f99c1abe-86b1-45d7-ae33-9c409be98da7 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:50.758237 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f99c1abe-86b1-45d7-ae33-9c409be98da7 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:50.764401 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f99c1abe-86b1-45d7-ae33-9c409be98da7 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:50.764876 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f99c1abe-86b1-45d7-ae33-9c409be98da7 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:50.765306 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f99c1abe-86b1-45d7-ae33-9c409be98da7 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:50.765985 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f99c1abe-86b1-45d7-ae33-9c409be98da7 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:50.766434 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f99c1abe-86b1-45d7-ae33-9c409be98da7 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:50.766845 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f99c1abe-86b1-45d7-ae33-9c409be98da7 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:50.898875 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f99c1abe-86b1-45d7-ae33-9c409be98da7 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:54:50.908355 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f99c1abe-86b1-45d7-ae33-9c409be98da7 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb" status: 200 len: 1319 microversion: 2.1 time: 0.154613 Aug 22 05:54:50.908831 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 538/1087] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:50 2022] GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:54:51.929793 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-6fa7ceaf-59d9-440e-9f68-80a6e13fdb6d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:51.930750 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-6fa7ceaf-59d9-440e-9f68-80a6e13fdb6d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:51.937506 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6fa7ceaf-59d9-440e-9f68-80a6e13fdb6d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:51.937980 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6fa7ceaf-59d9-440e-9f68-80a6e13fdb6d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:51.938404 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6fa7ceaf-59d9-440e-9f68-80a6e13fdb6d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:51.939085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6fa7ceaf-59d9-440e-9f68-80a6e13fdb6d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:51.939786 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6fa7ceaf-59d9-440e-9f68-80a6e13fdb6d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:51.939951 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-6fa7ceaf-59d9-440e-9f68-80a6e13fdb6d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:52.078494 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-6fa7ceaf-59d9-440e-9f68-80a6e13fdb6d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:54:52.087242 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-6fa7ceaf-59d9-440e-9f68-80a6e13fdb6d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb" status: 200 len: 1319 microversion: 2.1 time: 0.162593 Aug 22 05:54:52.087844 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 550/1088] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:51 2022] GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:54:53.112998 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-de4c2997-c0b0-46b3-8bee-cbdb0959d96d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:53.113871 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-de4c2997-c0b0-46b3-8bee-cbdb0959d96d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:53.124791 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de4c2997-c0b0-46b3-8bee-cbdb0959d96d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:53.125593 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de4c2997-c0b0-46b3-8bee-cbdb0959d96d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:53.126365 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de4c2997-c0b0-46b3-8bee-cbdb0959d96d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:53.127360 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de4c2997-c0b0-46b3-8bee-cbdb0959d96d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:53.127843 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de4c2997-c0b0-46b3-8bee-cbdb0959d96d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:53.128266 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de4c2997-c0b0-46b3-8bee-cbdb0959d96d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:53.267800 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-de4c2997-c0b0-46b3-8bee-cbdb0959d96d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:54:53.280335 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-de4c2997-c0b0-46b3-8bee-cbdb0959d96d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb" status: 200 len: 1319 microversion: 2.1 time: 0.173190 Aug 22 05:54:53.280335 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 539/1089] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:53 2022] GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:54:54.306072 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-1049a1c1-0bcd-4e82-aeeb-94df6ea3b92e tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:54.306670 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-1049a1c1-0bcd-4e82-aeeb-94df6ea3b92e tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:54.313461 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1049a1c1-0bcd-4e82-aeeb-94df6ea3b92e tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:54.313952 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1049a1c1-0bcd-4e82-aeeb-94df6ea3b92e tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:54.314765 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1049a1c1-0bcd-4e82-aeeb-94df6ea3b92e tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:54.315476 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1049a1c1-0bcd-4e82-aeeb-94df6ea3b92e tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:54.315968 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1049a1c1-0bcd-4e82-aeeb-94df6ea3b92e tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:54.316393 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1049a1c1-0bcd-4e82-aeeb-94df6ea3b92e tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:54.452482 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-1049a1c1-0bcd-4e82-aeeb-94df6ea3b92e tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:54:54.460533 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-1049a1c1-0bcd-4e82-aeeb-94df6ea3b92e tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb" status: 200 len: 1319 microversion: 2.1 time: 0.158357 Aug 22 05:54:54.461056 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 551/1090] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:54 2022] GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:54:55.485789 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d9ddcb47-2610-43ce-883d-ec79499d9620 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:55.487062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d9ddcb47-2610-43ce-883d-ec79499d9620 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:55.497882 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9ddcb47-2610-43ce-883d-ec79499d9620 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:55.498707 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9ddcb47-2610-43ce-883d-ec79499d9620 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:55.499423 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9ddcb47-2610-43ce-883d-ec79499d9620 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:55.500643 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9ddcb47-2610-43ce-883d-ec79499d9620 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:55.501394 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9ddcb47-2610-43ce-883d-ec79499d9620 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:55.502098 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9ddcb47-2610-43ce-883d-ec79499d9620 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:55.639494 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d9ddcb47-2610-43ce-883d-ec79499d9620 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:54:55.647504 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d9ddcb47-2610-43ce-883d-ec79499d9620 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb" status: 200 len: 1319 microversion: 2.1 time: 0.168260 Aug 22 05:54:55.648104 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 540/1091] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:55 2022] GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:54:56.019081 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-17f89882-bdc9-4498-9713-9c256a77b5d8 req-930d80b7-092a-44a3-a90d-dc38fabc9bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c3b1871-8ccf-4adc-8cd6-593ba642c6cb", "name": "network-vif-plugged", "status": "completed", "tag": "99335786-0aa5-4b90-a360-6c9a6948905f"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:54:56.028581 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-17f89882-bdc9-4498-9713-9c256a77b5d8 req-930d80b7-092a-44a3-a90d-dc38fabc9bf1 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:56.028974 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-17f89882-bdc9-4498-9713-9c256a77b5d8 req-930d80b7-092a-44a3-a90d-dc38fabc9bf1 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:56.029396 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-17f89882-bdc9-4498-9713-9c256a77b5d8 req-930d80b7-092a-44a3-a90d-dc38fabc9bf1 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:56.040390 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-17f89882-bdc9-4498-9713-9c256a77b5d8 req-930d80b7-092a-44a3-a90d-dc38fabc9bf1 service nova] Creating event network-vif-plugged:99335786-0aa5-4b90-a360-6c9a6948905f for instance 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb on hv-cinder-85391 Aug 22 05:54:56.045390 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-17f89882-bdc9-4498-9713-9c256a77b5d8 req-930d80b7-092a-44a3-a90d-dc38fabc9bf1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150865 Aug 22 05:54:56.045960 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 552/1092] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:54:56.676872 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-70a6e1a4-7cf5-4718-a091-3a4161cbc279 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:56.677674 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-70a6e1a4-7cf5-4718-a091-3a4161cbc279 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:56.686588 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70a6e1a4-7cf5-4718-a091-3a4161cbc279 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:56.687226 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70a6e1a4-7cf5-4718-a091-3a4161cbc279 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:56.687854 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70a6e1a4-7cf5-4718-a091-3a4161cbc279 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:56.688734 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70a6e1a4-7cf5-4718-a091-3a4161cbc279 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:56.689333 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70a6e1a4-7cf5-4718-a091-3a4161cbc279 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:56.689970 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70a6e1a4-7cf5-4718-a091-3a4161cbc279 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:56.829671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-70a6e1a4-7cf5-4718-a091-3a4161cbc279 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:54:56.842253 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-70a6e1a4-7cf5-4718-a091-3a4161cbc279 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb" status: 200 len: 1319 microversion: 2.1 time: 0.170091 Aug 22 05:54:56.843135 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 541/1093] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:56 2022] GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:54:57.861738 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=2 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:57.862609 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=6 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:57.867282 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-29e9cb77-0ae8-4fff-af07-ec5e7c7e44a4 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:54:57.868050 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-29e9cb77-0ae8-4fff-af07-ec5e7c7e44a4 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:54:57.875204 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-29e9cb77-0ae8-4fff-af07-ec5e7c7e44a4 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:57.875715 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-29e9cb77-0ae8-4fff-af07-ec5e7c7e44a4 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:57.876149 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-29e9cb77-0ae8-4fff-af07-ec5e7c7e44a4 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:57.876850 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-29e9cb77-0ae8-4fff-af07-ec5e7c7e44a4 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:54:57.877599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-29e9cb77-0ae8-4fff-af07-ec5e7c7e44a4 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:54:57.877726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-29e9cb77-0ae8-4fff-af07-ec5e7c7e44a4 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:54:58.017074 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-29e9cb77-0ae8-4fff-af07-ec5e7c7e44a4 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:54:58.025979 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-29e9cb77-0ae8-4fff-af07-ec5e7c7e44a4 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb" status: 200 len: 1507 microversion: 2.1 time: 0.165726 Aug 22 05:54:58.026545 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 553/1094] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:54:57 2022] GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:19.666969 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5ba27e5c-d559-46bd-9917-a6c18c6a7524 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ac5305c-9762-41f0-9924-0e9bb118dc37", "device": "/dev/sdb"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:55:19.670180 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5ba27e5c-d559-46bd-9917-a6c18c6a7524 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:19.672134 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:19.673008 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=14 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:19.673457 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=30 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:19.679121 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ba27e5c-d559-46bd-9917-a6c18c6a7524 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:19.679638 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ba27e5c-d559-46bd-9917-a6c18c6a7524 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:19.680061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ba27e5c-d559-46bd-9917-a6c18c6a7524 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:19.680739 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ba27e5c-d559-46bd-9917-a6c18c6a7524 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:19.681179 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ba27e5c-d559-46bd-9917-a6c18c6a7524 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:19.681589 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ba27e5c-d559-46bd-9917-a6c18c6a7524 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:21.545214 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5ba27e5c-d559-46bd-9917-a6c18c6a7524 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "POST /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.882296 Aug 22 05:55:21.545910 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 542/1095] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 22 05:55:19 2022] POST /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb/os-volume_attachments => generated 194 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:55:29.531794 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-84180083", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1539589973", "security_groups": [{"name": "tempest-secgroup-smoke-727561452"}], "block_device_mapping_v2": [{"uuid": "3e1199c3-356c-4d6e-a5c5-8bf7bdc1bf4a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eaf2e3cb-8f86-46d8-9db4-d025de139d15"}]}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:55:29.544036 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:29.544808 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=30 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:29.666363 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.network.neutron [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] validate_networks() for [('eaf2e3cb-8f86-46d8-9db4-d025de139d15', None, None, None, None, None)] {{(pid=132497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:55:30.081902 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Flavor limits 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:55:30.082619 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Image limits 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:55:30.083293 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Flavor pref 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:55:30.083739 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Image pref 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:55:30.084163 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:55:30.094441 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:30.094932 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:30.095406 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:30.096151 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:30.096609 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:30.097019 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:30.115842 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Getting quotas for project 6d3a9f50ec2d4fff938fcd6a79f5cdc9. Resources: {'cores', 'instances', 'ram'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:55:30.119777 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Getting quotas for user bb6d35f57b804ba5afa4ab86c46cd7c3 and project 6d3a9f50ec2d4fff938fcd6a79f5cdc9. Resources: {'cores', 'instances', 'ram'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:55:30.179033 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Going to run 1 instances... {{(pid=132497) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:55:30.181631 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e1199c3-356c-4d6e-a5c5-8bf7bdc1bf4a',volume_size=None,volume_type=None)] {{(pid=132497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:55:30.316087 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-01cb9e0c-c095-4018-ab16-02f10354efab tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.788267 Aug 22 05:55:30.317384 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 554/1096] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:55:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:55:30.333743 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ae79a50a-a90e-438f-9b9e-256c2531ac74 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:30.335325 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ae79a50a-a90e-438f-9b9e-256c2531ac74 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:30.339075 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:30.407321 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ae79a50a-a90e-438f-9b9e-256c2531ac74 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:30.414271 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ae79a50a-a90e-438f-9b9e-256c2531ac74 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1093 microversion: 2.1 time: 0.086367 Aug 22 05:55:30.414848 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 543/1097] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:30 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1093 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:31.435081 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-524c871d-883b-4670-ad33-8dd04b155b94 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:31.435733 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-524c871d-883b-4670-ad33-8dd04b155b94 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:31.442394 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-524c871d-883b-4670-ad33-8dd04b155b94 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:31.442869 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-524c871d-883b-4670-ad33-8dd04b155b94 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:31.443299 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-524c871d-883b-4670-ad33-8dd04b155b94 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:31.444010 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-524c871d-883b-4670-ad33-8dd04b155b94 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:31.444450 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-524c871d-883b-4670-ad33-8dd04b155b94 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:31.444863 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-524c871d-883b-4670-ad33-8dd04b155b94 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:31.509016 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-524c871d-883b-4670-ad33-8dd04b155b94 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:31.517211 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-524c871d-883b-4670-ad33-8dd04b155b94 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1191 microversion: 2.1 time: 0.086685 Aug 22 05:55:31.517771 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 555/1098] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:31 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:32.539194 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-721d072e-a3aa-4522-925c-72a724fe7f8e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:32.539927 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-721d072e-a3aa-4522-925c-72a724fe7f8e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:32.542266 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:32.551751 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-721d072e-a3aa-4522-925c-72a724fe7f8e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:32.552271 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-721d072e-a3aa-4522-925c-72a724fe7f8e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:32.552738 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-721d072e-a3aa-4522-925c-72a724fe7f8e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:32.553427 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-721d072e-a3aa-4522-925c-72a724fe7f8e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:32.553866 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-721d072e-a3aa-4522-925c-72a724fe7f8e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:32.554278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-721d072e-a3aa-4522-925c-72a724fe7f8e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:32.616237 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-721d072e-a3aa-4522-925c-72a724fe7f8e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:32.623967 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-721d072e-a3aa-4522-925c-72a724fe7f8e tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1191 microversion: 2.1 time: 0.088926 Aug 22 05:55:32.624507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 544/1099] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:32 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:33.648374 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-97a066aa-7f5a-4695-b410-15d3040f2351 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:33.649140 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-97a066aa-7f5a-4695-b410-15d3040f2351 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:33.657955 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-97a066aa-7f5a-4695-b410-15d3040f2351 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:33.658591 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-97a066aa-7f5a-4695-b410-15d3040f2351 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:33.659157 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-97a066aa-7f5a-4695-b410-15d3040f2351 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:33.660100 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-97a066aa-7f5a-4695-b410-15d3040f2351 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:33.660759 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-97a066aa-7f5a-4695-b410-15d3040f2351 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:33.661311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-97a066aa-7f5a-4695-b410-15d3040f2351 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:33.731467 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-97a066aa-7f5a-4695-b410-15d3040f2351 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:33.739795 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-97a066aa-7f5a-4695-b410-15d3040f2351 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1191 microversion: 2.1 time: 0.097031 Aug 22 05:55:33.740352 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 556/1100] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:33 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1191 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:34.764121 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-294cb66b-e8c3-48dd-8508-2ba496641d5b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:34.765020 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-294cb66b-e8c3-48dd-8508-2ba496641d5b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:34.778247 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-294cb66b-e8c3-48dd-8508-2ba496641d5b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:34.779798 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-294cb66b-e8c3-48dd-8508-2ba496641d5b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:34.781104 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-294cb66b-e8c3-48dd-8508-2ba496641d5b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:34.783021 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-294cb66b-e8c3-48dd-8508-2ba496641d5b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:34.784607 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-294cb66b-e8c3-48dd-8508-2ba496641d5b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:34.785886 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-294cb66b-e8c3-48dd-8508-2ba496641d5b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:34.861620 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-294cb66b-e8c3-48dd-8508-2ba496641d5b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:34.869849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-294cb66b-e8c3-48dd-8508-2ba496641d5b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1191 microversion: 2.1 time: 0.112346 Aug 22 05:55:34.870422 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 545/1101] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:34 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1191 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:35.891321 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e1ddf819-541d-4976-aced-5c4f802a17f7 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:35.891979 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e1ddf819-541d-4976-aced-5c4f802a17f7 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:35.918354 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e1ddf819-541d-4976-aced-5c4f802a17f7 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:35.918954 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e1ddf819-541d-4976-aced-5c4f802a17f7 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:35.919455 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e1ddf819-541d-4976-aced-5c4f802a17f7 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:35.920413 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e1ddf819-541d-4976-aced-5c4f802a17f7 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:35.920860 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e1ddf819-541d-4976-aced-5c4f802a17f7 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:35.921284 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e1ddf819-541d-4976-aced-5c4f802a17f7 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:36.129587 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e1ddf819-541d-4976-aced-5c4f802a17f7 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:36.142380 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e1ddf819-541d-4976-aced-5c4f802a17f7 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1276 microversion: 2.1 time: 0.255355 Aug 22 05:55:36.143730 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 557/1102] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:35 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1276 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:36.624560 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-331cf37d-12db-46f4-aee0-63ef1d0e6638 req-558200e4-0d42-48e2-a190-1f95ddc0ce7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eac07e2-0ca8-4713-b229-c8598c327577", "tag": "156a172c-d9e5-4d86-a0a3-3306c6d3ed53"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:55:36.643831 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-331cf37d-12db-46f4-aee0-63ef1d0e6638 req-558200e4-0d42-48e2-a190-1f95ddc0ce7b service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:36.644687 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-331cf37d-12db-46f4-aee0-63ef1d0e6638 req-558200e4-0d42-48e2-a190-1f95ddc0ce7b service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:36.645459 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-331cf37d-12db-46f4-aee0-63ef1d0e6638 req-558200e4-0d42-48e2-a190-1f95ddc0ce7b service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:36.659769 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-331cf37d-12db-46f4-aee0-63ef1d0e6638 req-558200e4-0d42-48e2-a190-1f95ddc0ce7b service nova] Creating event network-changed:156a172c-d9e5-4d86-a0a3-3306c6d3ed53 for instance 1eac07e2-0ca8-4713-b229-c8598c327577 on hv-cinder-85391 Aug 22 05:55:36.666386 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-331cf37d-12db-46f4-aee0-63ef1d0e6638 req-558200e4-0d42-48e2-a190-1f95ddc0ce7b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047605 Aug 22 05:55:36.667001 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 546/1103] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:55:37.168470 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7d2b0694-8856-4e1c-82f0-98fdf1098d1c tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:37.169244 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-7d2b0694-8856-4e1c-82f0-98fdf1098d1c tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:37.177926 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d2b0694-8856-4e1c-82f0-98fdf1098d1c tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:37.178702 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d2b0694-8856-4e1c-82f0-98fdf1098d1c tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:37.179276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d2b0694-8856-4e1c-82f0-98fdf1098d1c tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:37.180218 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d2b0694-8856-4e1c-82f0-98fdf1098d1c tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:37.180816 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d2b0694-8856-4e1c-82f0-98fdf1098d1c tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:37.181366 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d2b0694-8856-4e1c-82f0-98fdf1098d1c tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:37.319126 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-7d2b0694-8856-4e1c-82f0-98fdf1098d1c tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:37.327175 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-7d2b0694-8856-4e1c-82f0-98fdf1098d1c tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1264 microversion: 2.1 time: 0.164071 Aug 22 05:55:37.327787 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 558/1104] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:37 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:38.353805 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2cb397ac-b3d9-445b-b9b1-7b41d40ed5a4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:38.354924 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2cb397ac-b3d9-445b-b9b1-7b41d40ed5a4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:38.365662 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2cb397ac-b3d9-445b-b9b1-7b41d40ed5a4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:38.366138 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2cb397ac-b3d9-445b-b9b1-7b41d40ed5a4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:38.366592 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2cb397ac-b3d9-445b-b9b1-7b41d40ed5a4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:38.367274 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2cb397ac-b3d9-445b-b9b1-7b41d40ed5a4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:38.367753 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2cb397ac-b3d9-445b-b9b1-7b41d40ed5a4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:38.368168 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2cb397ac-b3d9-445b-b9b1-7b41d40ed5a4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:38.513302 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2cb397ac-b3d9-445b-b9b1-7b41d40ed5a4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:38.521665 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2cb397ac-b3d9-445b-b9b1-7b41d40ed5a4 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1264 microversion: 2.1 time: 0.174986 Aug 22 05:55:38.522308 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 547/1105] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:38 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:39.546680 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b7550e1e-66af-4137-ad72-7c78764230a3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:39.547665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b7550e1e-66af-4137-ad72-7c78764230a3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:39.560604 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7550e1e-66af-4137-ad72-7c78764230a3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:39.561105 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7550e1e-66af-4137-ad72-7c78764230a3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:39.561532 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7550e1e-66af-4137-ad72-7c78764230a3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:39.562224 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7550e1e-66af-4137-ad72-7c78764230a3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:39.563202 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7550e1e-66af-4137-ad72-7c78764230a3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:39.563643 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b7550e1e-66af-4137-ad72-7c78764230a3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:39.699805 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b7550e1e-66af-4137-ad72-7c78764230a3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:39.707821 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b7550e1e-66af-4137-ad72-7c78764230a3 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1264 microversion: 2.1 time: 0.167615 Aug 22 05:55:39.708402 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 559/1106] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:39 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:40.727524 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:40.731840 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5b8d0116-b284-411a-a13c-4a3e31dec8d9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:40.732449 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5b8d0116-b284-411a-a13c-4a3e31dec8d9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:40.738972 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5b8d0116-b284-411a-a13c-4a3e31dec8d9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:40.739463 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5b8d0116-b284-411a-a13c-4a3e31dec8d9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:40.739923 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5b8d0116-b284-411a-a13c-4a3e31dec8d9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:40.740596 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5b8d0116-b284-411a-a13c-4a3e31dec8d9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:40.741067 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5b8d0116-b284-411a-a13c-4a3e31dec8d9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:40.741494 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5b8d0116-b284-411a-a13c-4a3e31dec8d9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:40.879994 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5b8d0116-b284-411a-a13c-4a3e31dec8d9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:40.888452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5b8d0116-b284-411a-a13c-4a3e31dec8d9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1264 microversion: 2.1 time: 0.162335 Aug 22 05:55:40.889007 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 548/1107] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:40 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:41.909566 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8bcb6041-45fb-4e88-bc5d-67ec5a90f656 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:41.910137 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8bcb6041-45fb-4e88-bc5d-67ec5a90f656 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:41.912652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=2 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:41.913305 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=6 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:41.922601 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8bcb6041-45fb-4e88-bc5d-67ec5a90f656 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:41.923094 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8bcb6041-45fb-4e88-bc5d-67ec5a90f656 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:41.924042 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8bcb6041-45fb-4e88-bc5d-67ec5a90f656 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:41.924689 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8bcb6041-45fb-4e88-bc5d-67ec5a90f656 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:41.925151 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8bcb6041-45fb-4e88-bc5d-67ec5a90f656 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:41.925572 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8bcb6041-45fb-4e88-bc5d-67ec5a90f656 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:42.070927 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8bcb6041-45fb-4e88-bc5d-67ec5a90f656 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:42.078646 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8bcb6041-45fb-4e88-bc5d-67ec5a90f656 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1264 microversion: 2.1 time: 0.173049 Aug 22 05:55:42.079224 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 560/1108] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:41 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:43.104730 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-41a15ef1-3ca9-4469-b37c-d29d22736e7a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:43.105659 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-41a15ef1-3ca9-4469-b37c-d29d22736e7a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:43.116681 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41a15ef1-3ca9-4469-b37c-d29d22736e7a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:43.117441 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41a15ef1-3ca9-4469-b37c-d29d22736e7a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:43.118161 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41a15ef1-3ca9-4469-b37c-d29d22736e7a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:43.119301 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41a15ef1-3ca9-4469-b37c-d29d22736e7a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:43.120094 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41a15ef1-3ca9-4469-b37c-d29d22736e7a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:43.120793 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-41a15ef1-3ca9-4469-b37c-d29d22736e7a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:43.263519 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-41a15ef1-3ca9-4469-b37c-d29d22736e7a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:43.275313 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-41a15ef1-3ca9-4469-b37c-d29d22736e7a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1264 microversion: 2.1 time: 0.176975 Aug 22 05:55:43.276122 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 549/1109] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:43 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:44.304785 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-b0cc9502-26a2-4b0e-8689-4f7a7fcffeaa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:44.305500 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-b0cc9502-26a2-4b0e-8689-4f7a7fcffeaa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:44.313370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b0cc9502-26a2-4b0e-8689-4f7a7fcffeaa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:44.313936 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b0cc9502-26a2-4b0e-8689-4f7a7fcffeaa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:44.314478 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b0cc9502-26a2-4b0e-8689-4f7a7fcffeaa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:44.315288 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b0cc9502-26a2-4b0e-8689-4f7a7fcffeaa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:44.315862 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b0cc9502-26a2-4b0e-8689-4f7a7fcffeaa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:44.316360 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-b0cc9502-26a2-4b0e-8689-4f7a7fcffeaa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:44.452763 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-b0cc9502-26a2-4b0e-8689-4f7a7fcffeaa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:44.465328 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-b0cc9502-26a2-4b0e-8689-4f7a7fcffeaa tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1264 microversion: 2.1 time: 0.166816 Aug 22 05:55:44.466040 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 561/1110] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:44 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:45.493775 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8dcf2a46-ef2a-4a13-b183-af171beec6a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:45.494730 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8dcf2a46-ef2a-4a13-b183-af171beec6a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:45.506375 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8dcf2a46-ef2a-4a13-b183-af171beec6a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:45.507003 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8dcf2a46-ef2a-4a13-b183-af171beec6a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:45.507454 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8dcf2a46-ef2a-4a13-b183-af171beec6a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:45.508184 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8dcf2a46-ef2a-4a13-b183-af171beec6a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:45.508634 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8dcf2a46-ef2a-4a13-b183-af171beec6a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:45.509054 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8dcf2a46-ef2a-4a13-b183-af171beec6a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:45.648885 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8dcf2a46-ef2a-4a13-b183-af171beec6a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:45.656740 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8dcf2a46-ef2a-4a13-b183-af171beec6a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1264 microversion: 2.1 time: 0.169898 Aug 22 05:55:45.657316 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 550/1111] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:45 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:46.685829 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e13e5616-319f-4705-80c8-eed61257bf7b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:46.686765 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e13e5616-319f-4705-80c8-eed61257bf7b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:46.696496 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e13e5616-319f-4705-80c8-eed61257bf7b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:46.696977 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e13e5616-319f-4705-80c8-eed61257bf7b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:46.697385 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e13e5616-319f-4705-80c8-eed61257bf7b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:46.698107 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e13e5616-319f-4705-80c8-eed61257bf7b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:46.698560 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e13e5616-319f-4705-80c8-eed61257bf7b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:46.698982 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e13e5616-319f-4705-80c8-eed61257bf7b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:46.838612 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e13e5616-319f-4705-80c8-eed61257bf7b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:46.846964 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e13e5616-319f-4705-80c8-eed61257bf7b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1264 microversion: 2.1 time: 0.167663 Aug 22 05:55:46.847535 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 562/1112] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:46 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:47.869281 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b328f523-392a-458e-8e09-75a18a2a353b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:47.869899 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b328f523-392a-458e-8e09-75a18a2a353b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:47.876959 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b328f523-392a-458e-8e09-75a18a2a353b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:47.877443 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b328f523-392a-458e-8e09-75a18a2a353b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:47.877862 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b328f523-392a-458e-8e09-75a18a2a353b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:47.878547 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b328f523-392a-458e-8e09-75a18a2a353b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:47.878994 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b328f523-392a-458e-8e09-75a18a2a353b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:47.879412 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b328f523-392a-458e-8e09-75a18a2a353b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:48.030201 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b328f523-392a-458e-8e09-75a18a2a353b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:48.043658 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b328f523-392a-458e-8e09-75a18a2a353b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1264 microversion: 2.1 time: 0.178128 Aug 22 05:55:48.044519 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 551/1113] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:47 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:49.072194 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-01fa3ff2-e0d0-4c11-ae75-a0e44ebdf6b6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:49.072994 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-01fa3ff2-e0d0-4c11-ae75-a0e44ebdf6b6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:49.081856 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-01fa3ff2-e0d0-4c11-ae75-a0e44ebdf6b6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:49.082517 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-01fa3ff2-e0d0-4c11-ae75-a0e44ebdf6b6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:49.083085 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-01fa3ff2-e0d0-4c11-ae75-a0e44ebdf6b6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:49.084039 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-01fa3ff2-e0d0-4c11-ae75-a0e44ebdf6b6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:49.084633 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-01fa3ff2-e0d0-4c11-ae75-a0e44ebdf6b6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:49.085189 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-01fa3ff2-e0d0-4c11-ae75-a0e44ebdf6b6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:49.226246 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-01fa3ff2-e0d0-4c11-ae75-a0e44ebdf6b6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:49.234546 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-01fa3ff2-e0d0-4c11-ae75-a0e44ebdf6b6 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1264 microversion: 2.1 time: 0.168515 Aug 22 05:55:49.235148 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 563/1114] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:49 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:50.256083 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-65098348-b04d-4c09-a62d-1570c43a690a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:50.256733 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-65098348-b04d-4c09-a62d-1570c43a690a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:50.264360 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-65098348-b04d-4c09-a62d-1570c43a690a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:50.264858 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-65098348-b04d-4c09-a62d-1570c43a690a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:50.265289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-65098348-b04d-4c09-a62d-1570c43a690a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:50.265993 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-65098348-b04d-4c09-a62d-1570c43a690a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:50.266438 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-65098348-b04d-4c09-a62d-1570c43a690a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:50.266853 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-65098348-b04d-4c09-a62d-1570c43a690a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:50.409402 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-65098348-b04d-4c09-a62d-1570c43a690a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:50.419353 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-65098348-b04d-4c09-a62d-1570c43a690a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1264 microversion: 2.1 time: 0.167278 Aug 22 05:55:50.419971 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 552/1115] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:50 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:50.669478 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5a0ebcf9-ca9a-420b-aa18-44dd65989b97 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:50.670049 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5a0ebcf9-ca9a-420b-aa18-44dd65989b97 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:50.676412 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a0ebcf9-ca9a-420b-aa18-44dd65989b97 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:50.676890 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a0ebcf9-ca9a-420b-aa18-44dd65989b97 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:50.677311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a0ebcf9-ca9a-420b-aa18-44dd65989b97 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:50.677994 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a0ebcf9-ca9a-420b-aa18-44dd65989b97 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:50.678429 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a0ebcf9-ca9a-420b-aa18-44dd65989b97 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:50.678843 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5a0ebcf9-ca9a-420b-aa18-44dd65989b97 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:50.765047 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.objects.instance [None req-5a0ebcf9-ca9a-420b-aa18-44dd65989b97 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lazy-loading 'services' on Instance uuid 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb {{(pid=132497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:55:50.843838 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5a0ebcf9-ca9a-420b-aa18-44dd65989b97 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb/os-volume_attachments/2ac5305c-9762-41f0-9924-0e9bb118dc37" status: 202 len: 0 microversion: 2.1 time: 0.178033 Aug 22 05:55:50.844517 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 564/1116] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 22 05:55:50 2022] DELETE /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb/os-volume_attachments/2ac5305c-9762-41f0-9924-0e9bb118dc37 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:55:51.444986 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f0accae2-df62-4ea5-ae76-832b9c8af09f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:51.446367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f0accae2-df62-4ea5-ae76-832b9c8af09f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:51.454980 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f0accae2-df62-4ea5-ae76-832b9c8af09f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:51.455811 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f0accae2-df62-4ea5-ae76-832b9c8af09f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:51.456250 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f0accae2-df62-4ea5-ae76-832b9c8af09f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:51.456978 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f0accae2-df62-4ea5-ae76-832b9c8af09f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:51.457428 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f0accae2-df62-4ea5-ae76-832b9c8af09f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:51.457842 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f0accae2-df62-4ea5-ae76-832b9c8af09f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:51.605954 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f0accae2-df62-4ea5-ae76-832b9c8af09f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:51.614287 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f0accae2-df62-4ea5-ae76-832b9c8af09f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1264 microversion: 2.1 time: 0.175874 Aug 22 05:55:51.614859 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 553/1117] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:51 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:51.989851 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e1c6cb2b-9bdc-4e3a-9286-b37df9bbf764 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:51.990393 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e1c6cb2b-9bdc-4e3a-9286-b37df9bbf764 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:51.998615 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e1c6cb2b-9bdc-4e3a-9286-b37df9bbf764 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:51.999351 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e1c6cb2b-9bdc-4e3a-9286-b37df9bbf764 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:52.000124 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e1c6cb2b-9bdc-4e3a-9286-b37df9bbf764 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:52.001021 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e1c6cb2b-9bdc-4e3a-9286-b37df9bbf764 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:52.001473 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e1c6cb2b-9bdc-4e3a-9286-b37df9bbf764 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:52.001869 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e1c6cb2b-9bdc-4e3a-9286-b37df9bbf764 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:52.029781 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e1c6cb2b-9bdc-4e3a-9286-b37df9bbf764 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Going to try to terminate instance {{(pid=132497) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:55:52.110945 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e1c6cb2b-9bdc-4e3a-9286-b37df9bbf764 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb" status: 204 len: 0 microversion: 2.1 time: 0.125729 Aug 22 05:55:52.111549 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 565/1118] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:55:51 2022] DELETE /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:55:52.120279 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1aea8bcf-2fb2-4547-9d4f-95135e10dc76 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:52.121132 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1aea8bcf-2fb2-4547-9d4f-95135e10dc76 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:52.127254 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1aea8bcf-2fb2-4547-9d4f-95135e10dc76 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:52.127870 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1aea8bcf-2fb2-4547-9d4f-95135e10dc76 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:52.128368 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1aea8bcf-2fb2-4547-9d4f-95135e10dc76 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:52.129117 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1aea8bcf-2fb2-4547-9d4f-95135e10dc76 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:52.129565 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1aea8bcf-2fb2-4547-9d4f-95135e10dc76 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:52.129978 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1aea8bcf-2fb2-4547-9d4f-95135e10dc76 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:52.180803 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-b5c3aebd-c705-4081-ad02-cf01ca232837 req-6c6b4297-0355-49a7-8072-f9e6843e6c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eac07e2-0ca8-4713-b229-c8598c327577", "name": "network-vif-plugged", "status": "completed", "tag": "156a172c-d9e5-4d86-a0a3-3306c6d3ed53"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:55:52.192183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b5c3aebd-c705-4081-ad02-cf01ca232837 req-6c6b4297-0355-49a7-8072-f9e6843e6c5b service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:52.192675 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b5c3aebd-c705-4081-ad02-cf01ca232837 req-6c6b4297-0355-49a7-8072-f9e6843e6c5b service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:52.193107 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b5c3aebd-c705-4081-ad02-cf01ca232837 req-6c6b4297-0355-49a7-8072-f9e6843e6c5b service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:52.206252 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-b5c3aebd-c705-4081-ad02-cf01ca232837 req-6c6b4297-0355-49a7-8072-f9e6843e6c5b service nova] Creating event network-vif-plugged:156a172c-d9e5-4d86-a0a3-3306c6d3ed53 for instance 1eac07e2-0ca8-4713-b229-c8598c327577 on hv-cinder-85391 Aug 22 05:55:52.211390 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-b5c3aebd-c705-4081-ad02-cf01ca232837 req-6c6b4297-0355-49a7-8072-f9e6843e6c5b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034946 Aug 22 05:55:52.212451 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 566/1119] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:55:52.275791 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1aea8bcf-2fb2-4547-9d4f-95135e10dc76 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:52.284186 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1aea8bcf-2fb2-4547-9d4f-95135e10dc76 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb" status: 200 len: 1513 microversion: 2.1 time: 0.168052 Aug 22 05:55:52.284763 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 554/1120] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:52 2022] GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:52.640012 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-716918e6-9be9-45cc-b715-d3509e4bb0dd tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:52.640960 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-716918e6-9be9-45cc-b715-d3509e4bb0dd tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:52.649599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-716918e6-9be9-45cc-b715-d3509e4bb0dd tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:52.650231 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-716918e6-9be9-45cc-b715-d3509e4bb0dd tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:52.650797 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-716918e6-9be9-45cc-b715-d3509e4bb0dd tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:52.651739 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-716918e6-9be9-45cc-b715-d3509e4bb0dd tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:52.652332 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-716918e6-9be9-45cc-b715-d3509e4bb0dd tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:52.652881 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-716918e6-9be9-45cc-b715-d3509e4bb0dd tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:52.796486 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-716918e6-9be9-45cc-b715-d3509e4bb0dd tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:52.808753 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-716918e6-9be9-45cc-b715-d3509e4bb0dd tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1264 microversion: 2.1 time: 0.174229 Aug 22 05:55:52.809560 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 567/1121] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:52 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:53.310231 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f420244c-1ff3-433d-98fd-cf7ad30bbe44 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:53.311788 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f420244c-1ff3-433d-98fd-cf7ad30bbe44 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:53.320767 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f420244c-1ff3-433d-98fd-cf7ad30bbe44 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:53.321548 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f420244c-1ff3-433d-98fd-cf7ad30bbe44 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:53.322278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f420244c-1ff3-433d-98fd-cf7ad30bbe44 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:53.322977 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f420244c-1ff3-433d-98fd-cf7ad30bbe44 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:53.323434 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f420244c-1ff3-433d-98fd-cf7ad30bbe44 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:53.323862 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f420244c-1ff3-433d-98fd-cf7ad30bbe44 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:53.462732 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f420244c-1ff3-433d-98fd-cf7ad30bbe44 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:53.471202 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f420244c-1ff3-433d-98fd-cf7ad30bbe44 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb" status: 200 len: 1513 microversion: 2.1 time: 0.167220 Aug 22 05:55:53.471812 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 555/1122] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:53 2022] GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:53.838556 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ba531f00-8351-4b81-be39-dc64d7fa6600 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:53.839995 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ba531f00-8351-4b81-be39-dc64d7fa6600 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:53.847785 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba531f00-8351-4b81-be39-dc64d7fa6600 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:53.848276 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba531f00-8351-4b81-be39-dc64d7fa6600 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:53.848786 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba531f00-8351-4b81-be39-dc64d7fa6600 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:53.849596 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba531f00-8351-4b81-be39-dc64d7fa6600 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:53.850122 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba531f00-8351-4b81-be39-dc64d7fa6600 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:53.850618 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ba531f00-8351-4b81-be39-dc64d7fa6600 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:54.003815 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ba531f00-8351-4b81-be39-dc64d7fa6600 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:54.016931 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ba531f00-8351-4b81-be39-dc64d7fa6600 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1264 microversion: 2.1 time: 0.184739 Aug 22 05:55:54.017735 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 568/1123] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:53 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:54.496626 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-09fd9b9a-737d-4bf8-8b07-35df582f424c tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:54.497360 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-09fd9b9a-737d-4bf8-8b07-35df582f424c tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:54.503921 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09fd9b9a-737d-4bf8-8b07-35df582f424c tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:54.504401 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09fd9b9a-737d-4bf8-8b07-35df582f424c tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:54.504830 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09fd9b9a-737d-4bf8-8b07-35df582f424c tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:54.505517 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09fd9b9a-737d-4bf8-8b07-35df582f424c tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:54.505957 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09fd9b9a-737d-4bf8-8b07-35df582f424c tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:54.506372 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09fd9b9a-737d-4bf8-8b07-35df582f424c tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:54.652580 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-09fd9b9a-737d-4bf8-8b07-35df582f424c tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:54.660555 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-09fd9b9a-737d-4bf8-8b07-35df582f424c tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb" status: 200 len: 1513 microversion: 2.1 time: 0.170575 Aug 22 05:55:54.661140 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 556/1124] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:54 2022] GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:55.009859 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-a20c6b2f-8f6e-48d9-803c-677cfccf4f68 req-11891f6a-e9e0-4ed2-80b1-74b2e503c080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c3b1871-8ccf-4adc-8cd6-593ba642c6cb", "name": "network-vif-deleted", "tag": "99335786-0aa5-4b90-a360-6c9a6948905f"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:55:55.019962 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-a20c6b2f-8f6e-48d9-803c-677cfccf4f68 req-11891f6a-e9e0-4ed2-80b1-74b2e503c080 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:55.020440 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-a20c6b2f-8f6e-48d9-803c-677cfccf4f68 req-11891f6a-e9e0-4ed2-80b1-74b2e503c080 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:55.020862 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-a20c6b2f-8f6e-48d9-803c-677cfccf4f68 req-11891f6a-e9e0-4ed2-80b1-74b2e503c080 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:55.031810 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-a20c6b2f-8f6e-48d9-803c-677cfccf4f68 req-11891f6a-e9e0-4ed2-80b1-74b2e503c080 service nova] Creating event network-vif-deleted:99335786-0aa5-4b90-a360-6c9a6948905f for instance 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb on hv-cinder-85391 Aug 22 05:55:55.036823 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-a20c6b2f-8f6e-48d9-803c-677cfccf4f68 req-11891f6a-e9e0-4ed2-80b1-74b2e503c080 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031029 Aug 22 05:55:55.037401 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 569/1125] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:55:55.041452 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-58dd8d9c-d52b-4866-a1c8-1ed8f6ed40f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:55.042199 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-58dd8d9c-d52b-4866-a1c8-1ed8f6ed40f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:55.048538 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-58dd8d9c-d52b-4866-a1c8-1ed8f6ed40f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:55.049015 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-58dd8d9c-d52b-4866-a1c8-1ed8f6ed40f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:55.049442 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-58dd8d9c-d52b-4866-a1c8-1ed8f6ed40f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:55.050125 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-58dd8d9c-d52b-4866-a1c8-1ed8f6ed40f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:55.050573 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-58dd8d9c-d52b-4866-a1c8-1ed8f6ed40f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:55.050990 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-58dd8d9c-d52b-4866-a1c8-1ed8f6ed40f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:55.190311 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-58dd8d9c-d52b-4866-a1c8-1ed8f6ed40f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:55.198742 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-58dd8d9c-d52b-4866-a1c8-1ed8f6ed40f9 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1451 microversion: 2.1 time: 0.161341 Aug 22 05:55:55.199322 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 557/1126] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:55 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:55.225480 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5f924aff-afa2-49e6-8098-2f928bbd2c39 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:55.226166 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5f924aff-afa2-49e6-8098-2f928bbd2c39 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:55.232953 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f924aff-afa2-49e6-8098-2f928bbd2c39 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:55.233429 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f924aff-afa2-49e6-8098-2f928bbd2c39 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:55.233846 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f924aff-afa2-49e6-8098-2f928bbd2c39 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:55.234534 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f924aff-afa2-49e6-8098-2f928bbd2c39 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:55.234951 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f924aff-afa2-49e6-8098-2f928bbd2c39 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:55.235386 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5f924aff-afa2-49e6-8098-2f928bbd2c39 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:55.239615 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:55.379186 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-5f924aff-afa2-49e6-8098-2f928bbd2c39 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:55.388530 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5f924aff-afa2-49e6-8098-2f928bbd2c39 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1451 microversion: 2.1 time: 0.167133 Aug 22 05:55:55.389201 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 570/1127] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:55 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:55.681772 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2fae0300-7f6d-4f63-9e92-9d55f489f261 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:55.683705 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2fae0300-7f6d-4f63-9e92-9d55f489f261 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:55.690041 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2fae0300-7f6d-4f63-9e92-9d55f489f261 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:55.690508 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2fae0300-7f6d-4f63-9e92-9d55f489f261 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:55.691136 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2fae0300-7f6d-4f63-9e92-9d55f489f261 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:55.691860 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2fae0300-7f6d-4f63-9e92-9d55f489f261 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:55.692312 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2fae0300-7f6d-4f63-9e92-9d55f489f261 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:55.692866 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2fae0300-7f6d-4f63-9e92-9d55f489f261 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:55.728685 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2fae0300-7f6d-4f63-9e92-9d55f489f261 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:55.729244 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2fae0300-7f6d-4f63-9e92-9d55f489f261 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:55.729891 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2fae0300-7f6d-4f63-9e92-9d55f489f261 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:55.730179 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-2fae0300-7f6d-4f63-9e92-9d55f489f261 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lazy-loading 'fault' on Instance uuid 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:55:55.773970 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2fae0300-7f6d-4f63-9e92-9d55f489f261 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:55:55.783239 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2fae0300-7f6d-4f63-9e92-9d55f489f261 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb" status: 200 len: 1309 microversion: 2.1 time: 0.105360 Aug 22 05:55:55.783969 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 558/1128] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:55 2022] GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:55:56.805409 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-38a42bf6-208f-4175-94a7-95b65ec63f03 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:55:56.806029 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-38a42bf6-208f-4175-94a7-95b65ec63f03 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:55:56.812663 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-38a42bf6-208f-4175-94a7-95b65ec63f03 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:56.813139 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-38a42bf6-208f-4175-94a7-95b65ec63f03 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:56.813568 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-38a42bf6-208f-4175-94a7-95b65ec63f03 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:56.814351 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-38a42bf6-208f-4175-94a7-95b65ec63f03 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:56.814917 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-38a42bf6-208f-4175-94a7-95b65ec63f03 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:56.815343 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-38a42bf6-208f-4175-94a7-95b65ec63f03 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:56.829927 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-38a42bf6-208f-4175-94a7-95b65ec63f03 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] HTTP exception thrown: Instance 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb could not be found. Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-38a42bf6-208f-4175-94a7-95b65ec63f03 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Request method failure captured: Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb HTTP/1.1 Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxol20-_9HI8RwDX80fTqqR-NMGaSRySMmjac6J4okn9j5FxU99dkXv7DP5u28OCWHmF-YLgC1V3aZt-Tv2u-R44umJ7v9s8Ro3ga6x41H28Zb1fA0MqchzbHmkoXZKHUICx69GnLTxiWFmwn7sGtoNm3OniIjMVsKgHv80PcKj62To Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: a50845ada6944e769765e36f978ca716 Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-VolumesSnapshotTestJSON-792718020 Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:55:56.831621 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:55:56.833233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a50845ada6944e769765e36f978ca716", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a50845ada6944e769765e36f978ca716"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a50845ada6944e769765e36f978ca716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a50845ada6944e769765e36f978ca716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:55:56.833233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-VolumesSnapshotTestJSON-792718020 Aug 22 05:55:56.833233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: a50845ada6944e769765e36f978ca716 Aug 22 05:55:56.833233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-792718020 Aug 22 05:55:56.833233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-VolumesSnapshotTestJSON-792718020-project Aug 22 05:55:56.833233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:55:56.833233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:55:56.833233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: a821e4dcde67481bb33c574ac5973fd9 Aug 22 05:55:56.833233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-VolumesSnapshotTestJSON-792718020-project Aug 22 05:55:56.833233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:55:56.833233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb could not be found. Aug 22 05:55:56.833233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': '8c3b1871-8ccf-4adc-8cd6-593ba642c6cb'} Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb could not be found. Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:55:56.834195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb could not be found. Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb could not be found. Aug 22 05:55:56.835652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:55:56.836970 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-38a42bf6-208f-4175-94a7-95b65ec63f03 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Returning 404 to user: Instance 8c3b1871-8ccf-4adc-8cd6-593ba642c6cb could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:55:56.836970 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-38a42bf6-208f-4175-94a7-95b65ec63f03 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb" status: 404 len: 111 microversion: 2.1 time: 0.031582 Aug 22 05:55:56.836970 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 571/1129] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:55:56 2022] GET /compute/v2.1/servers/8c3b1871-8ccf-4adc-8cd6-593ba642c6cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:55:57.367152 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-3a18fc97-8bff-432c-adf2-cd20a51c9516 req-47dc8700-8ea2-40be-a592-c26648bf5d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eac07e2-0ca8-4713-b229-c8598c327577", "tag": "156a172c-d9e5-4d86-a0a3-3306c6d3ed53"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:55:57.377310 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-3a18fc97-8bff-432c-adf2-cd20a51c9516 req-47dc8700-8ea2-40be-a592-c26648bf5d46 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:55:57.377798 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-3a18fc97-8bff-432c-adf2-cd20a51c9516 req-47dc8700-8ea2-40be-a592-c26648bf5d46 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:55:57.378217 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-3a18fc97-8bff-432c-adf2-cd20a51c9516 req-47dc8700-8ea2-40be-a592-c26648bf5d46 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:55:57.389975 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-3a18fc97-8bff-432c-adf2-cd20a51c9516 req-47dc8700-8ea2-40be-a592-c26648bf5d46 service nova] Creating event network-changed:156a172c-d9e5-4d86-a0a3-3306c6d3ed53 for instance 1eac07e2-0ca8-4713-b229-c8598c327577 on hv-cinder-85391 Aug 22 05:55:57.395132 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-3a18fc97-8bff-432c-adf2-cd20a51c9516 req-47dc8700-8ea2-40be-a592-c26648bf5d46 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031782 Aug 22 05:55:57.395742 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 559/1130] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:56:08.840799 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-443507601", "imageRef": "122fc715-0ca9-4c4f-955a-eb0f4314ea2d", "flavorRef": "452", "networks": [{"uuid": "35c35c8f-c4a7-40e9-820d-7cf08fe1d173"}]}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:56:08.849431 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:08.850455 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=6 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:08.901134 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.network.neutron [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] validate_networks() for [('35c35c8f-c4a7-40e9-820d-7cf08fe1d173', None, None, None, None, None)] {{(pid=132497) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:56:09.306995 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Flavor limits 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:56:09.307410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Image limits 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:56:09.308126 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Flavor pref 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:56:09.308669 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Image pref 0:0:0 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:56:09.309138 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.virt.hardware [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:56:09.318798 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:09.319270 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:09.319782 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:09.320549 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:09.320995 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:09.321409 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:09.341781 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Getting quotas for project a50845ada6944e769765e36f978ca716. Resources: {'cores', 'instances', 'ram'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:56:09.345999 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Getting quotas for user a821e4dcde67481bb33c574ac5973fd9 and project a50845ada6944e769765e36f978ca716. Resources: {'cores', 'instances', 'ram'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:56:09.358931 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Going to run 1 instances... {{(pid=132497) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:56:09.361322 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='122fc715-0ca9-4c4f-955a-eb0f4314ea2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:56:09.418128 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c3ca27bc-e827-4288-bbf7-d485b5423fa5 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581574 Aug 22 05:56:09.423837 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 572/1131] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:56:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:56:09.428015 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=38 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:09.428886 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=90 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:09.435601 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-69b6321b-b918-45e1-9948-9aef7e3bd7b8 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:56:09.436324 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-69b6321b-b918-45e1-9948-9aef7e3bd7b8 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:56:09.499681 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-69b6321b-b918-45e1-9948-9aef7e3bd7b8 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:56:09.508376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-69b6321b-b918-45e1-9948-9aef7e3bd7b8 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4" status: 200 len: 1218 microversion: 2.1 time: 0.082311 Aug 22 05:56:09.508967 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 560/1132] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:56:09 2022] GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:56:10.534819 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-16a7ad93-c142-4d08-bf30-955673aa69da tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:56:10.536542 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-16a7ad93-c142-4d08-bf30-955673aa69da tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:56:10.544955 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-16a7ad93-c142-4d08-bf30-955673aa69da tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:10.545446 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-16a7ad93-c142-4d08-bf30-955673aa69da tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:10.545876 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-16a7ad93-c142-4d08-bf30-955673aa69da tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:10.546618 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-16a7ad93-c142-4d08-bf30-955673aa69da tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:10.547084 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-16a7ad93-c142-4d08-bf30-955673aa69da tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:10.547486 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-16a7ad93-c142-4d08-bf30-955673aa69da tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:10.616966 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-16a7ad93-c142-4d08-bf30-955673aa69da tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:56:10.624634 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-16a7ad93-c142-4d08-bf30-955673aa69da tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4" status: 200 len: 1278 microversion: 2.1 time: 0.094072 Aug 22 05:56:10.625197 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 573/1133] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:56:10 2022] GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 => generated 1278 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:56:11.646634 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fecb7161-cb89-4715-bba4-76e22e9a5ae6 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:56:11.647451 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fecb7161-cb89-4715-bba4-76e22e9a5ae6 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:56:11.654527 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fecb7161-cb89-4715-bba4-76e22e9a5ae6 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:11.655012 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fecb7161-cb89-4715-bba4-76e22e9a5ae6 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:11.655472 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fecb7161-cb89-4715-bba4-76e22e9a5ae6 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:11.656220 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fecb7161-cb89-4715-bba4-76e22e9a5ae6 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:11.656696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fecb7161-cb89-4715-bba4-76e22e9a5ae6 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:11.657110 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fecb7161-cb89-4715-bba4-76e22e9a5ae6 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:11.787687 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fecb7161-cb89-4715-bba4-76e22e9a5ae6 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:56:11.796067 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fecb7161-cb89-4715-bba4-76e22e9a5ae6 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4" status: 200 len: 1318 microversion: 2.1 time: 0.153646 Aug 22 05:56:11.796719 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 561/1134] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:56:11 2022] GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:56:11.880541 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-b3e7f27b-2154-43df-87aa-418f43c73525 req-8ccf0026-34dc-439a-8ee2-75b4879a3b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a54633c-f72b-49c5-adbd-c7b7c56e5eb4", "tag": "83990bc4-7494-49ac-972c-71a6ad39e6aa"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:56:11.889946 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b3e7f27b-2154-43df-87aa-418f43c73525 req-8ccf0026-34dc-439a-8ee2-75b4879a3b88 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:11.891009 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b3e7f27b-2154-43df-87aa-418f43c73525 req-8ccf0026-34dc-439a-8ee2-75b4879a3b88 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:11.891458 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-b3e7f27b-2154-43df-87aa-418f43c73525 req-8ccf0026-34dc-439a-8ee2-75b4879a3b88 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:11.903257 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-b3e7f27b-2154-43df-87aa-418f43c73525 req-8ccf0026-34dc-439a-8ee2-75b4879a3b88 service nova] Creating event network-changed:83990bc4-7494-49ac-972c-71a6ad39e6aa for instance 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 on hv-cinder-85391 Aug 22 05:56:11.908461 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-b3e7f27b-2154-43df-87aa-418f43c73525 req-8ccf0026-34dc-439a-8ee2-75b4879a3b88 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092448 Aug 22 05:56:11.909067 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 574/1135] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:56:12.822054 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d844ac63-5fd9-4c94-bb0f-57f21ff78f66 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:56:12.823003 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d844ac63-5fd9-4c94-bb0f-57f21ff78f66 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:56:12.829773 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d844ac63-5fd9-4c94-bb0f-57f21ff78f66 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:12.830258 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d844ac63-5fd9-4c94-bb0f-57f21ff78f66 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:12.830689 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d844ac63-5fd9-4c94-bb0f-57f21ff78f66 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:12.831374 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d844ac63-5fd9-4c94-bb0f-57f21ff78f66 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:12.831856 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d844ac63-5fd9-4c94-bb0f-57f21ff78f66 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:12.832278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d844ac63-5fd9-4c94-bb0f-57f21ff78f66 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:12.964626 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d844ac63-5fd9-4c94-bb0f-57f21ff78f66 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:56:12.972686 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d844ac63-5fd9-4c94-bb0f-57f21ff78f66 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4" status: 200 len: 1318 microversion: 2.1 time: 0.157299 Aug 22 05:56:12.973261 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 562/1136] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:56:12 2022] GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:56:13.997884 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-9522a0d2-ad59-448b-80bd-cf946ffc1049 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:56:13.998572 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-9522a0d2-ad59-448b-80bd-cf946ffc1049 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:56:14.005282 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9522a0d2-ad59-448b-80bd-cf946ffc1049 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:14.005757 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9522a0d2-ad59-448b-80bd-cf946ffc1049 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:14.006183 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9522a0d2-ad59-448b-80bd-cf946ffc1049 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:14.006869 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9522a0d2-ad59-448b-80bd-cf946ffc1049 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:14.007313 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9522a0d2-ad59-448b-80bd-cf946ffc1049 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:14.007764 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9522a0d2-ad59-448b-80bd-cf946ffc1049 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:14.150046 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-9522a0d2-ad59-448b-80bd-cf946ffc1049 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:56:14.161843 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-9522a0d2-ad59-448b-80bd-cf946ffc1049 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4" status: 200 len: 1318 microversion: 2.1 time: 0.170500 Aug 22 05:56:14.162370 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 575/1137] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:56:13 2022] GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:56:15.187652 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8f2d1a3a-843b-460b-968e-0e03a692a0f1 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:56:15.188643 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8f2d1a3a-843b-460b-968e-0e03a692a0f1 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:56:15.199461 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f2d1a3a-843b-460b-968e-0e03a692a0f1 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:15.200262 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f2d1a3a-843b-460b-968e-0e03a692a0f1 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:15.200663 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f2d1a3a-843b-460b-968e-0e03a692a0f1 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:15.201366 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f2d1a3a-843b-460b-968e-0e03a692a0f1 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:15.201810 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f2d1a3a-843b-460b-968e-0e03a692a0f1 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:15.202255 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f2d1a3a-843b-460b-968e-0e03a692a0f1 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:15.349228 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8f2d1a3a-843b-460b-968e-0e03a692a0f1 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:56:15.361319 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8f2d1a3a-843b-460b-968e-0e03a692a0f1 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4" status: 200 len: 1318 microversion: 2.1 time: 0.180136 Aug 22 05:56:15.362350 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 563/1138] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:56:15 2022] GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:56:16.285619 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-2e52a815-61d2-4433-a353-099232e5b41e req-2b0fee1d-e843-4758-ba52-4df56db4e168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a54633c-f72b-49c5-adbd-c7b7c56e5eb4", "name": "network-vif-plugged", "status": "completed", "tag": "83990bc4-7494-49ac-972c-71a6ad39e6aa"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:56:16.296413 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-2e52a815-61d2-4433-a353-099232e5b41e req-2b0fee1d-e843-4758-ba52-4df56db4e168 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:16.296895 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-2e52a815-61d2-4433-a353-099232e5b41e req-2b0fee1d-e843-4758-ba52-4df56db4e168 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:16.297324 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-2e52a815-61d2-4433-a353-099232e5b41e req-2b0fee1d-e843-4758-ba52-4df56db4e168 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:16.311802 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-2e52a815-61d2-4433-a353-099232e5b41e req-2b0fee1d-e843-4758-ba52-4df56db4e168 service nova] Creating event network-vif-plugged:83990bc4-7494-49ac-972c-71a6ad39e6aa for instance 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 on hv-cinder-85391 Aug 22 05:56:16.316811 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-2e52a815-61d2-4433-a353-099232e5b41e req-2b0fee1d-e843-4758-ba52-4df56db4e168 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034944 Aug 22 05:56:16.317663 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 576/1139] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:56:16.386078 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-767c68ab-9621-40cd-98ba-cc9c00364d0a tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:56:16.386772 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-767c68ab-9621-40cd-98ba-cc9c00364d0a tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:56:16.393869 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-767c68ab-9621-40cd-98ba-cc9c00364d0a tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:16.394348 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-767c68ab-9621-40cd-98ba-cc9c00364d0a tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:16.394778 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-767c68ab-9621-40cd-98ba-cc9c00364d0a tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:16.395659 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-767c68ab-9621-40cd-98ba-cc9c00364d0a tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:16.396109 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-767c68ab-9621-40cd-98ba-cc9c00364d0a tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:16.396529 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-767c68ab-9621-40cd-98ba-cc9c00364d0a tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:16.538063 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-767c68ab-9621-40cd-98ba-cc9c00364d0a tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:56:16.546028 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-767c68ab-9621-40cd-98ba-cc9c00364d0a tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4" status: 200 len: 1318 microversion: 2.1 time: 0.164433 Aug 22 05:56:16.546596 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 564/1140] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:56:16 2022] GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:56:17.572481 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-19e24232-ab85-4fbf-a031-dc0a84c1d11d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:56:17.573623 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-19e24232-ab85-4fbf-a031-dc0a84c1d11d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:56:17.581014 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19e24232-ab85-4fbf-a031-dc0a84c1d11d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:17.581514 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19e24232-ab85-4fbf-a031-dc0a84c1d11d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:17.581938 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19e24232-ab85-4fbf-a031-dc0a84c1d11d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:17.582618 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19e24232-ab85-4fbf-a031-dc0a84c1d11d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:17.583059 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19e24232-ab85-4fbf-a031-dc0a84c1d11d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:17.583468 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-19e24232-ab85-4fbf-a031-dc0a84c1d11d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:17.718929 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-19e24232-ab85-4fbf-a031-dc0a84c1d11d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:56:17.727315 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-19e24232-ab85-4fbf-a031-dc0a84c1d11d tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4" status: 200 len: 1318 microversion: 2.1 time: 0.162673 Aug 22 05:56:17.727933 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 577/1141] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:56:17 2022] GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:56:18.752123 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-95a50d8c-f6e2-48eb-aff3-ebeecf17fd17 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:56:18.753128 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-95a50d8c-f6e2-48eb-aff3-ebeecf17fd17 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:56:18.764383 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-95a50d8c-f6e2-48eb-aff3-ebeecf17fd17 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:18.765149 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-95a50d8c-f6e2-48eb-aff3-ebeecf17fd17 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:18.765580 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-95a50d8c-f6e2-48eb-aff3-ebeecf17fd17 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:18.766415 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-95a50d8c-f6e2-48eb-aff3-ebeecf17fd17 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:18.766860 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-95a50d8c-f6e2-48eb-aff3-ebeecf17fd17 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:18.767293 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-95a50d8c-f6e2-48eb-aff3-ebeecf17fd17 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:18.900342 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-95a50d8c-f6e2-48eb-aff3-ebeecf17fd17 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:56:18.909778 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-95a50d8c-f6e2-48eb-aff3-ebeecf17fd17 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4" status: 200 len: 1506 microversion: 2.1 time: 0.164208 Aug 22 05:56:18.910547 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 565/1142] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:56:18 2022] GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:56:18.930965 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7d890aef-6b72-4976-b9f2-1ca0fa10b1fa tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a070eef3-989b-4bc2-b6f6-f04801dfc4e7", "device": "/dev/sdb"}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:56:18.933877 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-7d890aef-6b72-4976-b9f2-1ca0fa10b1fa tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:56:18.940471 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d890aef-6b72-4976-b9f2-1ca0fa10b1fa tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:18.941043 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d890aef-6b72-4976-b9f2-1ca0fa10b1fa tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:18.941485 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d890aef-6b72-4976-b9f2-1ca0fa10b1fa tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:18.942172 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d890aef-6b72-4976-b9f2-1ca0fa10b1fa tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:18.942617 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d890aef-6b72-4976-b9f2-1ca0fa10b1fa tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:18.943037 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-7d890aef-6b72-4976-b9f2-1ca0fa10b1fa tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:19.222650 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-7d890aef-6b72-4976-b9f2-1ca0fa10b1fa tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "POST /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295524 Aug 22 05:56:19.223260 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 578/1143] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 22 05:56:18 2022] POST /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:56:41.916395 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f3c3f38b-f90f-4b53-b7a9-dcb130ea6d92 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:56:41.916949 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f3c3f38b-f90f-4b53-b7a9-dcb130ea6d92 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:56:41.918691 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:41.919972 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=14 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:41.920587 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=30 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:41.926622 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3c3f38b-f90f-4b53-b7a9-dcb130ea6d92 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:41.927093 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3c3f38b-f90f-4b53-b7a9-dcb130ea6d92 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:41.927521 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3c3f38b-f90f-4b53-b7a9-dcb130ea6d92 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:41.928225 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3c3f38b-f90f-4b53-b7a9-dcb130ea6d92 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:41.928674 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3c3f38b-f90f-4b53-b7a9-dcb130ea6d92 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:41.929082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3c3f38b-f90f-4b53-b7a9-dcb130ea6d92 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:42.017075 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-f3c3f38b-f90f-4b53-b7a9-dcb130ea6d92 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lazy-loading 'services' on Instance uuid 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 05:56:42.104456 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f3c3f38b-f90f-4b53-b7a9-dcb130ea6d92 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4/os-volume_attachments/a070eef3-989b-4bc2-b6f6-f04801dfc4e7" status: 202 len: 0 microversion: 2.1 time: 0.191888 Aug 22 05:56:42.105037 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 566/1144] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 22 05:56:41 2022] DELETE /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4/os-volume_attachments/a070eef3-989b-4bc2-b6f6-f04801dfc4e7 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:56:43.234207 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-703f7fbd-ca8d-4fab-bfdc-45a4d7e1e778 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:56:43.234765 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-703f7fbd-ca8d-4fab-bfdc-45a4d7e1e778 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:56:43.238277 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=2 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:43.238998 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=6 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:43.239926 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:43.240769 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:43.248500 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-703f7fbd-ca8d-4fab-bfdc-45a4d7e1e778 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:43.249005 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-703f7fbd-ca8d-4fab-bfdc-45a4d7e1e778 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:43.249432 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-703f7fbd-ca8d-4fab-bfdc-45a4d7e1e778 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:43.250125 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-703f7fbd-ca8d-4fab-bfdc-45a4d7e1e778 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:43.250565 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-703f7fbd-ca8d-4fab-bfdc-45a4d7e1e778 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:43.250997 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-703f7fbd-ca8d-4fab-bfdc-45a4d7e1e778 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:43.286673 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-703f7fbd-ca8d-4fab-bfdc-45a4d7e1e778 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Going to try to terminate instance {{(pid=132497) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:56:43.370117 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-703f7fbd-ca8d-4fab-bfdc-45a4d7e1e778 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4" status: 204 len: 0 microversion: 2.1 time: 0.142152 Aug 22 05:56:43.370740 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 579/1145] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:56:43 2022] DELETE /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:56:43.380305 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ed4eebb1-bf48-4eff-bff4-ac9cd137f618 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:56:43.381062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ed4eebb1-bf48-4eff-bff4-ac9cd137f618 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:56:43.387163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ed4eebb1-bf48-4eff-bff4-ac9cd137f618 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:43.387734 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ed4eebb1-bf48-4eff-bff4-ac9cd137f618 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:43.388163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ed4eebb1-bf48-4eff-bff4-ac9cd137f618 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:43.388836 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ed4eebb1-bf48-4eff-bff4-ac9cd137f618 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:43.389271 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ed4eebb1-bf48-4eff-bff4-ac9cd137f618 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:43.389681 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ed4eebb1-bf48-4eff-bff4-ac9cd137f618 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:43.532103 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ed4eebb1-bf48-4eff-bff4-ac9cd137f618 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:56:43.540167 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ed4eebb1-bf48-4eff-bff4-ac9cd137f618 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4" status: 200 len: 1512 microversion: 2.1 time: 0.164736 Aug 22 05:56:43.540736 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 567/1146] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:56:43 2022] GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:56:44.567035 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8b28cf5d-9f76-4775-8044-194a5806d1c0 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:56:44.568260 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8b28cf5d-9f76-4775-8044-194a5806d1c0 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:56:44.577826 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b28cf5d-9f76-4775-8044-194a5806d1c0 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:44.578308 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b28cf5d-9f76-4775-8044-194a5806d1c0 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:44.578739 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b28cf5d-9f76-4775-8044-194a5806d1c0 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:44.579457 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b28cf5d-9f76-4775-8044-194a5806d1c0 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:44.579938 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b28cf5d-9f76-4775-8044-194a5806d1c0 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:44.580361 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8b28cf5d-9f76-4775-8044-194a5806d1c0 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:44.726349 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8b28cf5d-9f76-4775-8044-194a5806d1c0 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:56:44.735950 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8b28cf5d-9f76-4775-8044-194a5806d1c0 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4" status: 200 len: 1512 microversion: 2.1 time: 0.176016 Aug 22 05:56:44.736518 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 580/1147] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:56:44 2022] GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:56:45.757613 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-85b653ef-96c6-43ac-8c88-aa784a19be3b tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:56:45.758592 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-85b653ef-96c6-43ac-8c88-aa784a19be3b tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:56:45.766544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85b653ef-96c6-43ac-8c88-aa784a19be3b tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:45.767485 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85b653ef-96c6-43ac-8c88-aa784a19be3b tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:45.767930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85b653ef-96c6-43ac-8c88-aa784a19be3b tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:45.768843 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85b653ef-96c6-43ac-8c88-aa784a19be3b tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:45.769297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85b653ef-96c6-43ac-8c88-aa784a19be3b tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:45.769717 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85b653ef-96c6-43ac-8c88-aa784a19be3b tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:45.833880 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-1d6f0dc8-d9ea-4182-a436-e7de19f64d6d req-9b009081-8416-43b9-94b3-e41503658206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a54633c-f72b-49c5-adbd-c7b7c56e5eb4", "name": "network-vif-deleted", "tag": "83990bc4-7494-49ac-972c-71a6ad39e6aa"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:56:45.844261 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-85b653ef-96c6-43ac-8c88-aa784a19be3b tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a821e4dcde67481bb33c574ac5973fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50845ada6944e769765e36f978ca716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:56:45.847076 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-1d6f0dc8-d9ea-4182-a436-e7de19f64d6d req-9b009081-8416-43b9-94b3-e41503658206 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:45.847809 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-1d6f0dc8-d9ea-4182-a436-e7de19f64d6d req-9b009081-8416-43b9-94b3-e41503658206 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:45.848235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-1d6f0dc8-d9ea-4182-a436-e7de19f64d6d req-9b009081-8416-43b9-94b3-e41503658206 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:45.852240 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-85b653ef-96c6-43ac-8c88-aa784a19be3b tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4" status: 200 len: 1470 microversion: 2.1 time: 0.098753 Aug 22 05:56:45.866787 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 568/1148] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:56:45 2022] GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 => generated 1470 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:56:45.874442 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-1d6f0dc8-d9ea-4182-a436-e7de19f64d6d req-9b009081-8416-43b9-94b3-e41503658206 service nova] Creating event network-vif-deleted:83990bc4-7494-49ac-972c-71a6ad39e6aa for instance 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 on hv-cinder-85391 Aug 22 05:56:45.879200 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-1d6f0dc8-d9ea-4182-a436-e7de19f64d6d req-9b009081-8416-43b9-94b3-e41503658206 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049146 Aug 22 05:56:45.879828 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 581/1149] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:56:46.877995 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0fbb4be1-6c36-462d-9bc5-aa0d0f2f3530 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:56:46.878748 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0fbb4be1-6c36-462d-9bc5-aa0d0f2f3530 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] [instance: 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:56:46.887179 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0fbb4be1-6c36-462d-9bc5-aa0d0f2f3530 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:46.887821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0fbb4be1-6c36-462d-9bc5-aa0d0f2f3530 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:46.888359 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0fbb4be1-6c36-462d-9bc5-aa0d0f2f3530 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:46.889831 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0fbb4be1-6c36-462d-9bc5-aa0d0f2f3530 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:56:46.890408 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0fbb4be1-6c36-462d-9bc5-aa0d0f2f3530 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:56:46.890930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0fbb4be1-6c36-462d-9bc5-aa0d0f2f3530 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:56:46.908337 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-0fbb4be1-6c36-462d-9bc5-aa0d0f2f3530 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] HTTP exception thrown: Instance 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 could not be found. Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0fbb4be1-6c36-462d-9bc5-aa0d0f2f3530 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Request method failure captured: Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 HTTP/1.1 Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxol20-_9HI8RwDX80fTqqR-NMGaSRySMmjac6J4okn9j5FxU99dkXv7DP5u28OCWHmF-YLgC1V3aZt-Tv2u-R44umJ7v9s8Ro3ga6x41H28Zb1fA0MqchzbHmkoXZKHUICx69GnLTxiWFmwn7sGtoNm3OniIjMVsKgHv80PcKj62To Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: a50845ada6944e769765e36f978ca716 Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesSnapshotTestJSON-792718020 Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:56:46.910064 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:56:46.911947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a50845ada6944e769765e36f978ca716", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a50845ada6944e769765e36f978ca716"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a50845ada6944e769765e36f978ca716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a50845ada6944e769765e36f978ca716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:56:46.911947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesSnapshotTestJSON-792718020 Aug 22 05:56:46.911947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: a50845ada6944e769765e36f978ca716 Aug 22 05:56:46.911947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-792718020 Aug 22 05:56:46.911947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesSnapshotTestJSON-792718020-project Aug 22 05:56:46.911947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:56:46.911947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:56:46.911947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: a821e4dcde67481bb33c574ac5973fd9 Aug 22 05:56:46.911947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesSnapshotTestJSON-792718020-project Aug 22 05:56:46.911947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:56:46.911947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 could not be found. Aug 22 05:56:46.911947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '3a54633c-f72b-49c5-adbd-c7b7c56e5eb4'} Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 could not be found. Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:56:46.912942 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 could not be found. Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 could not be found. Aug 22 05:56:46.914526 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:56:46.916005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0fbb4be1-6c36-462d-9bc5-aa0d0f2f3530 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] Returning 404 to user: Instance 3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:56:46.916005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0fbb4be1-6c36-462d-9bc5-aa0d0f2f3530 tempest-VolumesSnapshotTestJSON-792718020 tempest-VolumesSnapshotTestJSON-792718020-project] 10.222.0.18 "GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4" status: 404 len: 111 microversion: 2.1 time: 0.038892 Aug 22 05:56:46.916005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 569/1150] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:56:46 2022] GET /compute/v2.1/servers/3a54633c-f72b-49c5-adbd-c7b7c56e5eb4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:57:33.590267 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:33.591017 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:33.595523 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-50fd8f36-8f84-4f26-8988-6342a1905998 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Action: 'create', calling method: .version_select at 0x7f0b42832d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-508942434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0BJlut0kptHb2kzk1Z7tSbcEA4BxWDoiHTBhaAMLYwr2Zpkk/Z1/19vznGpbU8qkDVfqYVcn7Qh3uimaWq9q9JSm7aTuhHglvNKQDsJb+V27impir84mEaoOfxeUwcZg=="}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:57:33.613956 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-50fd8f36-8f84-4f26-8988-6342a1905998 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Getting quotas for project 5f84b1b8d6e44140b80a668e08afcaff. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:57:33.617949 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.quota [None req-50fd8f36-8f84-4f26-8988-6342a1905998 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Getting quotas for user 5e119e8e09aa4a8bb7cc96952f292833 and project 5f84b1b8d6e44140b80a668e08afcaff. Resources: {'key_pairs'} {{(pid=132497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:57:33.629929 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR oslo.messaging._drivers.impl_rabbit [None req-50fd8f36-8f84-4f26-8988-6342a1905998 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [9ad23e60-93e0-46f9-b546-44a4e8bd6fe3] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 05:57:34.638498 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO oslo.messaging._drivers.impl_rabbit [None req-50fd8f36-8f84-4f26-8988-6342a1905998 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [9ad23e60-93e0-46f9-b546-44a4e8bd6fe3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58374. Aug 22 05:57:34.656553 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-50fd8f36-8f84-4f26-8988-6342a1905998 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.068328 Aug 22 05:57:34.657166 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 582/1151] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 22 05:57:33 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:57:34.714678 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1012906062", "imageRef": "27d8cc4a-5fae-423a-a08c-6f9478e2b6b5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-508942434", "networks": [{"uuid": "a4d58756-ce1c-46b2-810b-8fce3821e88b"}]}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:57:34.723770 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=8 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:34.724512 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:34.779379 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] validate_networks() for [('a4d58756-ce1c-46b2-810b-8fce3821e88b', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 05:57:35.260127 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 05:57:35.260542 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 05:57:35.261005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 05:57:35.261398 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 05:57:35.261797 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 05:57:35.271039 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:35.271519 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:35.272002 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:35.272716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:35.273157 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:35.273568 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:35.290744 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Getting quotas for project 5f84b1b8d6e44140b80a668e08afcaff. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 05:57:35.294718 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Getting quotas for user 5e119e8e09aa4a8bb7cc96952f292833 and project 5f84b1b8d6e44140b80a668e08afcaff. Resources: {'cores', 'instances', 'ram'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 05:57:35.305990 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 05:57:35.308298 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27d8cc4a-5fae-423a-a08c-6f9478e2b6b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 05:57:35.355562 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [1df99b61-4f54-4f0f-89e1-58e1cda62f1a] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 05:57:36.365343 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO oslo.messaging._drivers.impl_rabbit [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [1df99b61-4f54-4f0f-89e1-58e1cda62f1a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58390. Aug 22 05:57:36.369547 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-dbb1901a-9254-42d3-bc74-3c0af4d7b1b0 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.659272 Aug 22 05:57:36.370184 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 570/1152] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 22 05:57:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 05:57:36.381644 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-9c0338bc-351c-4919-91e7-26443b69a17e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:36.385349 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-9c0338bc-351c-4919-91e7-26443b69a17e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:36.441607 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-9c0338bc-351c-4919-91e7-26443b69a17e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:36.448665 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-9c0338bc-351c-4919-91e7-26443b69a17e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1258 microversion: 2.1 time: 0.071360 Aug 22 05:57:36.449233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 583/1153] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:36 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:37.474054 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c88be69f-04c5-4077-bdf9-d52f3147098d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:37.474944 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c88be69f-04c5-4077-bdf9-d52f3147098d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:37.484744 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c88be69f-04c5-4077-bdf9-d52f3147098d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:37.485550 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c88be69f-04c5-4077-bdf9-d52f3147098d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:37.485919 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c88be69f-04c5-4077-bdf9-d52f3147098d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:37.486604 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c88be69f-04c5-4077-bdf9-d52f3147098d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:37.487058 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c88be69f-04c5-4077-bdf9-d52f3147098d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:37.487463 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c88be69f-04c5-4077-bdf9-d52f3147098d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:37.551693 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c88be69f-04c5-4077-bdf9-d52f3147098d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:37.562733 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c88be69f-04c5-4077-bdf9-d52f3147098d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1318 microversion: 2.1 time: 0.095378 Aug 22 05:57:37.563956 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 571/1154] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:37 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1318 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:38.584811 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e9251d13-a87f-4851-8224-94e0ff62a49e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:38.585358 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e9251d13-a87f-4851-8224-94e0ff62a49e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:38.592679 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e9251d13-a87f-4851-8224-94e0ff62a49e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:38.593170 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e9251d13-a87f-4851-8224-94e0ff62a49e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:38.593610 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e9251d13-a87f-4851-8224-94e0ff62a49e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:38.594620 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e9251d13-a87f-4851-8224-94e0ff62a49e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:38.595368 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e9251d13-a87f-4851-8224-94e0ff62a49e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:38.595942 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e9251d13-a87f-4851-8224-94e0ff62a49e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:38.754414 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-e9251d13-a87f-4851-8224-94e0ff62a49e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:38.765404 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e9251d13-a87f-4851-8224-94e0ff62a49e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1358 microversion: 2.1 time: 0.184319 Aug 22 05:57:38.769388 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 584/1155] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:38 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:39.786854 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bd8cae52-006c-48b9-9ea3-524660391263 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:39.787432 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-bd8cae52-006c-48b9-9ea3-524660391263 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:39.794159 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd8cae52-006c-48b9-9ea3-524660391263 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:39.794625 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd8cae52-006c-48b9-9ea3-524660391263 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:39.795151 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd8cae52-006c-48b9-9ea3-524660391263 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:39.795947 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd8cae52-006c-48b9-9ea3-524660391263 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:39.796453 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd8cae52-006c-48b9-9ea3-524660391263 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:39.796881 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd8cae52-006c-48b9-9ea3-524660391263 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:39.933889 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-bd8cae52-006c-48b9-9ea3-524660391263 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:39.942531 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-bd8cae52-006c-48b9-9ea3-524660391263 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1358 microversion: 2.1 time: 0.159682 Aug 22 05:57:39.944655 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 572/1156] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:39 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:40.965794 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-0858479f-7652-491c-93f7-72f64174b048 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:40.967422 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-0858479f-7652-491c-93f7-72f64174b048 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:40.975705 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0858479f-7652-491c-93f7-72f64174b048 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:40.976320 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0858479f-7652-491c-93f7-72f64174b048 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:40.976855 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0858479f-7652-491c-93f7-72f64174b048 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:40.977726 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0858479f-7652-491c-93f7-72f64174b048 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:40.978251 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0858479f-7652-491c-93f7-72f64174b048 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:40.978679 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-0858479f-7652-491c-93f7-72f64174b048 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:41.124279 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-0858479f-7652-491c-93f7-72f64174b048 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:41.132534 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-0858479f-7652-491c-93f7-72f64174b048 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1358 microversion: 2.1 time: 0.172570 Aug 22 05:57:41.133064 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 585/1157] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:40 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:42.154551 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a1ba2d2e-08c8-4da8-8d5d-d4f97847b0fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:42.155119 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a1ba2d2e-08c8-4da8-8d5d-d4f97847b0fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:42.161416 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a1ba2d2e-08c8-4da8-8d5d-d4f97847b0fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:42.162155 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a1ba2d2e-08c8-4da8-8d5d-d4f97847b0fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:42.162790 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a1ba2d2e-08c8-4da8-8d5d-d4f97847b0fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:42.163756 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a1ba2d2e-08c8-4da8-8d5d-d4f97847b0fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:42.164373 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a1ba2d2e-08c8-4da8-8d5d-d4f97847b0fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:42.164960 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a1ba2d2e-08c8-4da8-8d5d-d4f97847b0fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:42.310403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a1ba2d2e-08c8-4da8-8d5d-d4f97847b0fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:42.319415 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a1ba2d2e-08c8-4da8-8d5d-d4f97847b0fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1358 microversion: 2.1 time: 0.168949 Aug 22 05:57:42.320865 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 573/1158] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:42 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:43.341327 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-77b6dfd3-024c-4ccb-b69c-82d61ee16519 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:43.341915 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-77b6dfd3-024c-4ccb-b69c-82d61ee16519 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:43.348484 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-77b6dfd3-024c-4ccb-b69c-82d61ee16519 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:43.348968 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-77b6dfd3-024c-4ccb-b69c-82d61ee16519 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:43.349394 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-77b6dfd3-024c-4ccb-b69c-82d61ee16519 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:43.350114 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-77b6dfd3-024c-4ccb-b69c-82d61ee16519 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:43.350536 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-77b6dfd3-024c-4ccb-b69c-82d61ee16519 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:43.350960 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-77b6dfd3-024c-4ccb-b69c-82d61ee16519 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:43.486839 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-77b6dfd3-024c-4ccb-b69c-82d61ee16519 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:43.494693 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-77b6dfd3-024c-4ccb-b69c-82d61ee16519 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1358 microversion: 2.1 time: 0.157647 Aug 22 05:57:43.495261 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 586/1159] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:43 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:44.517692 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-613f7a8a-2095-4818-842d-455e0d0e2aa5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:44.519163 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-613f7a8a-2095-4818-842d-455e0d0e2aa5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:44.527638 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-613f7a8a-2095-4818-842d-455e0d0e2aa5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:44.528464 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-613f7a8a-2095-4818-842d-455e0d0e2aa5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:44.529082 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-613f7a8a-2095-4818-842d-455e0d0e2aa5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:44.529976 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-613f7a8a-2095-4818-842d-455e0d0e2aa5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:44.530609 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-613f7a8a-2095-4818-842d-455e0d0e2aa5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:44.531218 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-613f7a8a-2095-4818-842d-455e0d0e2aa5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:44.691455 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-613f7a8a-2095-4818-842d-455e0d0e2aa5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:44.700292 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-613f7a8a-2095-4818-842d-455e0d0e2aa5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1358 microversion: 2.1 time: 0.186819 Aug 22 05:57:44.701207 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 574/1160] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:44 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:45.721958 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-20727ae9-99b8-4e1e-9f3a-426fd1c57c8c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:45.724615 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-20727ae9-99b8-4e1e-9f3a-426fd1c57c8c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:45.732888 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-20727ae9-99b8-4e1e-9f3a-426fd1c57c8c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:45.733760 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-20727ae9-99b8-4e1e-9f3a-426fd1c57c8c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:45.734608 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-20727ae9-99b8-4e1e-9f3a-426fd1c57c8c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:45.735559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-20727ae9-99b8-4e1e-9f3a-426fd1c57c8c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:45.736129 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-20727ae9-99b8-4e1e-9f3a-426fd1c57c8c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:45.736618 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-20727ae9-99b8-4e1e-9f3a-426fd1c57c8c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:45.878181 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-20727ae9-99b8-4e1e-9f3a-426fd1c57c8c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:45.891534 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-20727ae9-99b8-4e1e-9f3a-426fd1c57c8c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1358 microversion: 2.1 time: 0.173837 Aug 22 05:57:45.892385 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 587/1161] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:45 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:46.913715 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-dc7b4209-99e0-44c0-b855-db1425ceaf36 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:46.914297 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-dc7b4209-99e0-44c0-b855-db1425ceaf36 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:46.916348 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:46.917012 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=6 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:46.924125 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dc7b4209-99e0-44c0-b855-db1425ceaf36 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:46.924634 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dc7b4209-99e0-44c0-b855-db1425ceaf36 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:46.925061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dc7b4209-99e0-44c0-b855-db1425ceaf36 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:46.925766 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dc7b4209-99e0-44c0-b855-db1425ceaf36 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:46.926229 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dc7b4209-99e0-44c0-b855-db1425ceaf36 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:46.926638 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dc7b4209-99e0-44c0-b855-db1425ceaf36 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:47.064904 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-dc7b4209-99e0-44c0-b855-db1425ceaf36 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:47.074703 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-dc7b4209-99e0-44c0-b855-db1425ceaf36 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1358 microversion: 2.1 time: 0.164965 Aug 22 05:57:47.075288 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 575/1162] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:46 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:48.096633 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8c74a05f-5ede-4108-b8de-a272a1434065 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:48.097287 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8c74a05f-5ede-4108-b8de-a272a1434065 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:48.099361 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=6 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:48.106038 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8c74a05f-5ede-4108-b8de-a272a1434065 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:48.106544 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8c74a05f-5ede-4108-b8de-a272a1434065 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:48.106973 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8c74a05f-5ede-4108-b8de-a272a1434065 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:48.107732 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8c74a05f-5ede-4108-b8de-a272a1434065 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:48.108202 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8c74a05f-5ede-4108-b8de-a272a1434065 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:48.108635 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8c74a05f-5ede-4108-b8de-a272a1434065 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:48.245493 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8c74a05f-5ede-4108-b8de-a272a1434065 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:48.256180 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8c74a05f-5ede-4108-b8de-a272a1434065 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1358 microversion: 2.1 time: 0.163432 Aug 22 05:57:48.257104 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 588/1163] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:48 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:49.282453 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0eea90c6-fecd-4f36-8a17-fc1ea1428536 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:49.283367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0eea90c6-fecd-4f36-8a17-fc1ea1428536 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:49.294439 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0eea90c6-fecd-4f36-8a17-fc1ea1428536 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:49.295223 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0eea90c6-fecd-4f36-8a17-fc1ea1428536 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:49.296006 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0eea90c6-fecd-4f36-8a17-fc1ea1428536 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:49.297126 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0eea90c6-fecd-4f36-8a17-fc1ea1428536 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:49.297853 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0eea90c6-fecd-4f36-8a17-fc1ea1428536 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:49.298586 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0eea90c6-fecd-4f36-8a17-fc1ea1428536 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:49.430658 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0eea90c6-fecd-4f36-8a17-fc1ea1428536 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:49.438382 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0eea90c6-fecd-4f36-8a17-fc1ea1428536 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1358 microversion: 2.1 time: 0.162546 Aug 22 05:57:49.438990 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 576/1164] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:49 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:50.453292 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-54b5dd21-6358-4954-99cd-199c00603cd0 req-74985026-3079-4ae2-ba28-e273f1d96a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ea9c57-9074-4057-b7b2-9d27deb95268", "tag": "bb2d58f3-53b0-416d-9d06-3975fcbcd318"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:57:50.459536 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3ada44cf-d28e-4748-8f83-a0392fbbd057 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:50.460333 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3ada44cf-d28e-4748-8f83-a0392fbbd057 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:50.473017 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-54b5dd21-6358-4954-99cd-199c00603cd0 req-74985026-3079-4ae2-ba28-e273f1d96a9e service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:50.473479 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-54b5dd21-6358-4954-99cd-199c00603cd0 req-74985026-3079-4ae2-ba28-e273f1d96a9e service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:50.473610 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ada44cf-d28e-4748-8f83-a0392fbbd057 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:50.473908 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-54b5dd21-6358-4954-99cd-199c00603cd0 req-74985026-3079-4ae2-ba28-e273f1d96a9e service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:50.474036 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ada44cf-d28e-4748-8f83-a0392fbbd057 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:50.474431 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ada44cf-d28e-4748-8f83-a0392fbbd057 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:50.475141 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ada44cf-d28e-4748-8f83-a0392fbbd057 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:50.475692 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ada44cf-d28e-4748-8f83-a0392fbbd057 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:50.476507 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ada44cf-d28e-4748-8f83-a0392fbbd057 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:50.486197 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-54b5dd21-6358-4954-99cd-199c00603cd0 req-74985026-3079-4ae2-ba28-e273f1d96a9e service nova] Creating event network-changed:bb2d58f3-53b0-416d-9d06-3975fcbcd318 for instance 13ea9c57-9074-4057-b7b2-9d27deb95268 on hv-cinder-85391 Aug 22 05:57:50.492026 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-54b5dd21-6358-4954-99cd-199c00603cd0 req-74985026-3079-4ae2-ba28-e273f1d96a9e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043294 Aug 22 05:57:50.492506 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 589/1165] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 05:57:50.615952 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3ada44cf-d28e-4748-8f83-a0392fbbd057 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:50.624530 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3ada44cf-d28e-4748-8f83-a0392fbbd057 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1358 microversion: 2.1 time: 0.169593 Aug 22 05:57:50.625116 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 577/1166] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:50 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:51.649692 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-42c35704-7c4d-4dfb-a9bc-accf83a1fed4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:51.650363 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-42c35704-7c4d-4dfb-a9bc-accf83a1fed4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:51.657062 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-42c35704-7c4d-4dfb-a9bc-accf83a1fed4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:51.657541 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-42c35704-7c4d-4dfb-a9bc-accf83a1fed4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:51.657969 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-42c35704-7c4d-4dfb-a9bc-accf83a1fed4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:51.658656 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-42c35704-7c4d-4dfb-a9bc-accf83a1fed4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:51.659100 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-42c35704-7c4d-4dfb-a9bc-accf83a1fed4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:51.659515 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-42c35704-7c4d-4dfb-a9bc-accf83a1fed4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:51.797019 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-42c35704-7c4d-4dfb-a9bc-accf83a1fed4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:51.805496 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-42c35704-7c4d-4dfb-a9bc-accf83a1fed4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1358 microversion: 2.1 time: 0.162055 Aug 22 05:57:51.806043 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 590/1167] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:51 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:52.826432 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f9d1df72-cbd6-4afa-8b28-f3202890e15c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:52.827094 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f9d1df72-cbd6-4afa-8b28-f3202890e15c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:52.834263 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f9d1df72-cbd6-4afa-8b28-f3202890e15c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:52.834655 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f9d1df72-cbd6-4afa-8b28-f3202890e15c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:52.835316 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f9d1df72-cbd6-4afa-8b28-f3202890e15c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:52.836116 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f9d1df72-cbd6-4afa-8b28-f3202890e15c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:52.836562 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f9d1df72-cbd6-4afa-8b28-f3202890e15c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:52.836978 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f9d1df72-cbd6-4afa-8b28-f3202890e15c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:52.977570 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f9d1df72-cbd6-4afa-8b28-f3202890e15c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:52.985260 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f9d1df72-cbd6-4afa-8b28-f3202890e15c tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1358 microversion: 2.1 time: 0.162859 Aug 22 05:57:52.985821 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 578/1168] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:52 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:54.011311 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-fe06b3b3-3890-46b9-9a9a-87e6faa82509 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:54.012349 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-fe06b3b3-3890-46b9-9a9a-87e6faa82509 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:54.028334 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fe06b3b3-3890-46b9-9a9a-87e6faa82509 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:54.028817 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fe06b3b3-3890-46b9-9a9a-87e6faa82509 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:54.029247 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fe06b3b3-3890-46b9-9a9a-87e6faa82509 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:54.031490 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fe06b3b3-3890-46b9-9a9a-87e6faa82509 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:54.032295 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fe06b3b3-3890-46b9-9a9a-87e6faa82509 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:54.033090 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-fe06b3b3-3890-46b9-9a9a-87e6faa82509 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:54.174462 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-fe06b3b3-3890-46b9-9a9a-87e6faa82509 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:54.187174 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-fe06b3b3-3890-46b9-9a9a-87e6faa82509 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1358 microversion: 2.1 time: 0.182195 Aug 22 05:57:54.188040 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 591/1169] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:54 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:54.778861 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-f3b38849-4665-4045-aee4-7f00bfcf7a58 req-0882382a-24bb-4e4e-bb3c-09eefc834d07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ea9c57-9074-4057-b7b2-9d27deb95268", "name": "network-vif-plugged", "status": "completed", "tag": "bb2d58f3-53b0-416d-9d06-3975fcbcd318"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:57:54.791084 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-f3b38849-4665-4045-aee4-7f00bfcf7a58 req-0882382a-24bb-4e4e-bb3c-09eefc834d07 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:54.791559 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-f3b38849-4665-4045-aee4-7f00bfcf7a58 req-0882382a-24bb-4e4e-bb3c-09eefc834d07 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:54.792027 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-f3b38849-4665-4045-aee4-7f00bfcf7a58 req-0882382a-24bb-4e4e-bb3c-09eefc834d07 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:54.804357 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-f3b38849-4665-4045-aee4-7f00bfcf7a58 req-0882382a-24bb-4e4e-bb3c-09eefc834d07 service nova] Creating event network-vif-plugged:bb2d58f3-53b0-416d-9d06-3975fcbcd318 for instance 13ea9c57-9074-4057-b7b2-9d27deb95268 on hv-cinder-85391 Aug 22 05:57:54.809557 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-f3b38849-4665-4045-aee4-7f00bfcf7a58 req-0882382a-24bb-4e4e-bb3c-09eefc834d07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034993 Aug 22 05:57:54.810326 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 579/1170] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:57:55.215854 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-744b0a1f-aaba-4c3d-bbe0-88b6132b1332 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:55.216772 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-744b0a1f-aaba-4c3d-bbe0-88b6132b1332 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:55.227519 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-744b0a1f-aaba-4c3d-bbe0-88b6132b1332 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:55.228025 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-744b0a1f-aaba-4c3d-bbe0-88b6132b1332 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:55.228456 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-744b0a1f-aaba-4c3d-bbe0-88b6132b1332 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:55.229157 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-744b0a1f-aaba-4c3d-bbe0-88b6132b1332 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:55.229599 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-744b0a1f-aaba-4c3d-bbe0-88b6132b1332 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:55.230017 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-744b0a1f-aaba-4c3d-bbe0-88b6132b1332 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:55.379603 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-744b0a1f-aaba-4c3d-bbe0-88b6132b1332 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:55.387540 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-744b0a1f-aaba-4c3d-bbe0-88b6132b1332 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1358 microversion: 2.1 time: 0.179188 Aug 22 05:57:55.388165 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 592/1171] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:55 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:56.413355 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-03432fc0-50de-4f6f-a347-7f5df00f34d2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:56.414052 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-03432fc0-50de-4f6f-a347-7f5df00f34d2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:56.420795 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03432fc0-50de-4f6f-a347-7f5df00f34d2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:56.421278 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03432fc0-50de-4f6f-a347-7f5df00f34d2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:56.421711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03432fc0-50de-4f6f-a347-7f5df00f34d2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:56.422417 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03432fc0-50de-4f6f-a347-7f5df00f34d2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:56.422868 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03432fc0-50de-4f6f-a347-7f5df00f34d2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:56.423289 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-03432fc0-50de-4f6f-a347-7f5df00f34d2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:56.558448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-03432fc0-50de-4f6f-a347-7f5df00f34d2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:56.568858 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-03432fc0-50de-4f6f-a347-7f5df00f34d2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1358 microversion: 2.1 time: 0.162902 Aug 22 05:57:56.569765 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 580/1172] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:56 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:57.601312 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-1436984c-b991-4bb1-95da-3f43d7ace9cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:57.602416 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-1436984c-b991-4bb1-95da-3f43d7ace9cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:57.614544 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1436984c-b991-4bb1-95da-3f43d7ace9cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:57.615417 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1436984c-b991-4bb1-95da-3f43d7ace9cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:57.616237 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1436984c-b991-4bb1-95da-3f43d7ace9cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:57.617327 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1436984c-b991-4bb1-95da-3f43d7ace9cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:57.617767 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1436984c-b991-4bb1-95da-3f43d7ace9cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:57.618181 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-1436984c-b991-4bb1-95da-3f43d7ace9cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:57.758104 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-1436984c-b991-4bb1-95da-3f43d7ace9cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:57.766007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-1436984c-b991-4bb1-95da-3f43d7ace9cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1547 microversion: 2.1 time: 0.171755 Aug 22 05:57:57.766578 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 593/1173] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:57 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1547 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:57.789054 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-808584b9-8f21-4f93-a5ad-4a3e84d801f9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:57.790041 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-808584b9-8f21-4f93-a5ad-4a3e84d801f9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:57.800233 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-808584b9-8f21-4f93-a5ad-4a3e84d801f9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:57.800993 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-808584b9-8f21-4f93-a5ad-4a3e84d801f9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:57.801680 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-808584b9-8f21-4f93-a5ad-4a3e84d801f9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:57.802784 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-808584b9-8f21-4f93-a5ad-4a3e84d801f9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:57.803502 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-808584b9-8f21-4f93-a5ad-4a3e84d801f9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:57.804348 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-808584b9-8f21-4f93-a5ad-4a3e84d801f9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:57.938326 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-808584b9-8f21-4f93-a5ad-4a3e84d801f9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:57.946694 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-808584b9-8f21-4f93-a5ad-4a3e84d801f9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1547 microversion: 2.1 time: 0.164095 Aug 22 05:57:57.947254 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 581/1174] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:57 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 05:57:57.977715 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-c1c64b90-1506-4961-8444-2df0a82904b9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:57.982535 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-c1c64b90-1506-4961-8444-2df0a82904b9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:57.983307 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-c1c64b90-1506-4961-8444-2df0a82904b9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Searching by: {'deleted': False, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff'} {{(pid=132497) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 05:57:57.990329 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c1c64b90-1506-4961-8444-2df0a82904b9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:57.990801 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c1c64b90-1506-4961-8444-2df0a82904b9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:57.991234 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c1c64b90-1506-4961-8444-2df0a82904b9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:57.992197 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c1c64b90-1506-4961-8444-2df0a82904b9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:57.992643 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c1c64b90-1506-4961-8444-2df0a82904b9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:57.993062 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-c1c64b90-1506-4961-8444-2df0a82904b9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:58.082096 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.multi_cell_list [None req-c1c64b90-1506-4961-8444-2df0a82904b9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132497) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 22 05:57:58.174269 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-c1c64b90-1506-4961-8444-2df0a82904b9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202310 Aug 22 05:57:58.174902 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 594/1175] 10.222.0.18 () {58 vars in 1125 bytes} [Mon Aug 22 05:57:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:57:58.193188 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c75454c3-9e9d-468a-8388-4b120577d309 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:57:58.194140 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c75454c3-9e9d-468a-8388-4b120577d309 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:58.200559 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c75454c3-9e9d-468a-8388-4b120577d309 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:58.201035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c75454c3-9e9d-468a-8388-4b120577d309 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:58.201461 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c75454c3-9e9d-468a-8388-4b120577d309 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:58.202139 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c75454c3-9e9d-468a-8388-4b120577d309 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:58.202576 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c75454c3-9e9d-468a-8388-4b120577d309 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:58.202986 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c75454c3-9e9d-468a-8388-4b120577d309 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:58.341803 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c75454c3-9e9d-468a-8388-4b120577d309 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:57:58.350248 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c75454c3-9e9d-468a-8388-4b120577d309 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1547 microversion: 2.1 time: 0.163463 Aug 22 05:57:58.350818 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 582/1176] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:57:58 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:57:59.925129 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-5181b528-a440-4834-bd79-2808ef152076 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b89b366-7826-4f17-8494-67bb5acadbf7"}} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:57:59.927440 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-5181b528-a440-4834-bd79-2808ef152076 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:57:59.934359 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5181b528-a440-4834-bd79-2808ef152076 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:59.934766 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5181b528-a440-4834-bd79-2808ef152076 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:59.935193 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5181b528-a440-4834-bd79-2808ef152076 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:57:59.935916 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5181b528-a440-4834-bd79-2808ef152076 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:57:59.936358 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5181b528-a440-4834-bd79-2808ef152076 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:57:59.936774 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-5181b528-a440-4834-bd79-2808ef152076 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:00.214362 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-5181b528-a440-4834-bd79-2808ef152076 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "POST /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292495 Aug 22 05:58:00.215163 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 595/1177] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 22 05:57:59 2022] POST /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:58:07.865985 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a06c9718-b12d-4e3e-b0c2-656307fa9bee tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:58:07.867018 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a06c9718-b12d-4e3e-b0c2-656307fa9bee tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:58:07.871484 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:07.875254 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a06c9718-b12d-4e3e-b0c2-656307fa9bee tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:07.875775 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a06c9718-b12d-4e3e-b0c2-656307fa9bee tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:07.876204 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a06c9718-b12d-4e3e-b0c2-656307fa9bee tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:07.876921 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a06c9718-b12d-4e3e-b0c2-656307fa9bee tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:07.877365 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a06c9718-b12d-4e3e-b0c2-656307fa9bee tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:07.877781 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a06c9718-b12d-4e3e-b0c2-656307fa9bee tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:07.881386 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=71 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:08.019441 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a06c9718-b12d-4e3e-b0c2-656307fa9bee tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:58:08.031446 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a06c9718-b12d-4e3e-b0c2-656307fa9bee tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1593 microversion: 2.1 time: 0.170942 Aug 22 05:58:08.032069 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 583/1178] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:58:07 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1593 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:58:09.954175 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell0:SELECT=2 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:09.955026 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:09.959310 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-4407e119-d244-49d5-bc22-2d8bcebc4b8c req-7328126c-6151-4ab8-81be-3a56f0fed28b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ea9c57-9074-4057-b7b2-9d27deb95268", "tag": "bb2d58f3-53b0-416d-9d06-3975fcbcd318"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:58:09.970712 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-4407e119-d244-49d5-bc22-2d8bcebc4b8c req-7328126c-6151-4ab8-81be-3a56f0fed28b service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:09.971234 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-4407e119-d244-49d5-bc22-2d8bcebc4b8c req-7328126c-6151-4ab8-81be-3a56f0fed28b service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:09.971653 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-4407e119-d244-49d5-bc22-2d8bcebc4b8c req-7328126c-6151-4ab8-81be-3a56f0fed28b service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:09.982533 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:09.984517 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-4407e119-d244-49d5-bc22-2d8bcebc4b8c req-7328126c-6151-4ab8-81be-3a56f0fed28b service nova] Creating event network-changed:bb2d58f3-53b0-416d-9d06-3975fcbcd318 for instance 13ea9c57-9074-4057-b7b2-9d27deb95268 on hv-cinder-85391 Aug 22 05:58:09.991281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-4407e119-d244-49d5-bc22-2d8bcebc4b8c req-7328126c-6151-4ab8-81be-3a56f0fed28b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038239 Aug 22 05:58:09.992080 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 596/1179] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:58:10.995849 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-19ed0df3-f6eb-41c2-b635-1c8a12ba3bd9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1746893917"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:58:10.996373 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-19ed0df3-f6eb-41c2-b635-1c8a12ba3bd9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:58:11.002986 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19ed0df3-f6eb-41c2-b635-1c8a12ba3bd9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:11.003740 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19ed0df3-f6eb-41c2-b635-1c8a12ba3bd9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:11.004162 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19ed0df3-f6eb-41c2-b635-1c8a12ba3bd9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:11.004865 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19ed0df3-f6eb-41c2-b635-1c8a12ba3bd9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:11.005304 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19ed0df3-f6eb-41c2-b635-1c8a12ba3bd9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:11.005714 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-19ed0df3-f6eb-41c2-b635-1c8a12ba3bd9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:11.154959 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.network.security_group_api [None req-19ed0df3-f6eb-41c2-b635-1c8a12ba3bd9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Adding security group 1fec6425-7849-4d6d-9cd9-c34746865995 to port bb2d58f3-53b0-416d-9d06-3975fcbcd318 Aug 22 05:58:11.520997 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-19ed0df3-f6eb-41c2-b635-1c8a12ba3bd9 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "POST /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/action" status: 202 len: 0 microversion: 2.1 time: 0.530758 Aug 22 05:58:11.522114 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 584/1180] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 22 05:58:10 2022] POST /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:58:11.531325 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f583ad1c-059d-4c5a-96da-24885b929aa2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:58:11.534780 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f583ad1c-059d-4c5a-96da-24885b929aa2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:58:11.543147 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f583ad1c-059d-4c5a-96da-24885b929aa2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:11.545040 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f583ad1c-059d-4c5a-96da-24885b929aa2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:11.545647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f583ad1c-059d-4c5a-96da-24885b929aa2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:11.546573 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f583ad1c-059d-4c5a-96da-24885b929aa2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:11.547246 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f583ad1c-059d-4c5a-96da-24885b929aa2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:11.547856 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f583ad1c-059d-4c5a-96da-24885b929aa2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:11.758951 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f583ad1c-059d-4c5a-96da-24885b929aa2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:58:11.766776 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-2fb9ee45-7954-4d86-ae10-ab7c1c579d0b req-c001175b-a0cc-46ff-98a9-12dcfce25f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ea9c57-9074-4057-b7b2-9d27deb95268", "tag": "bb2d58f3-53b0-416d-9d06-3975fcbcd318"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:58:11.775814 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f583ad1c-059d-4c5a-96da-24885b929aa2 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1759 microversion: 2.1 time: 0.248983 Aug 22 05:58:11.776610 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-2fb9ee45-7954-4d86-ae10-ab7c1c579d0b req-c001175b-a0cc-46ff-98a9-12dcfce25f47 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:11.776764 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 585/1181] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:58:11 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1759 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:58:11.777573 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-2fb9ee45-7954-4d86-ae10-ab7c1c579d0b req-c001175b-a0cc-46ff-98a9-12dcfce25f47 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:11.779148 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-2fb9ee45-7954-4d86-ae10-ab7c1c579d0b req-c001175b-a0cc-46ff-98a9-12dcfce25f47 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:11.794563 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-2fb9ee45-7954-4d86-ae10-ab7c1c579d0b req-c001175b-a0cc-46ff-98a9-12dcfce25f47 service nova] Creating event network-changed:bb2d58f3-53b0-416d-9d06-3975fcbcd318 for instance 13ea9c57-9074-4057-b7b2-9d27deb95268 on hv-cinder-85391 Aug 22 05:58:11.801500 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-2fb9ee45-7954-4d86-ae10-ab7c1c579d0b req-c001175b-a0cc-46ff-98a9-12dcfce25f47 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.274917 Aug 22 05:58:11.805563 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 597/1182] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:58:13.009252 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b9b03b86-58ef-44c9-bede-087aeba03bbb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:58:13.009866 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b9b03b86-58ef-44c9-bede-087aeba03bbb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:58:13.011450 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-172a8a9c-d1a4-4f18-880c-19d3ba919a91 req-7d488896-1356-4273-98bb-cc647425b385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eac07e2-0ca8-4713-b229-c8598c327577", "tag": "156a172c-d9e5-4d86-a0a3-3306c6d3ed53"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:58:13.016716 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b9b03b86-58ef-44c9-bede-087aeba03bbb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:13.017219 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b9b03b86-58ef-44c9-bede-087aeba03bbb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:13.017641 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b9b03b86-58ef-44c9-bede-087aeba03bbb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:13.018366 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b9b03b86-58ef-44c9-bede-087aeba03bbb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:13.018812 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b9b03b86-58ef-44c9-bede-087aeba03bbb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:13.019234 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b9b03b86-58ef-44c9-bede-087aeba03bbb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:13.022037 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-172a8a9c-d1a4-4f18-880c-19d3ba919a91 req-7d488896-1356-4273-98bb-cc647425b385 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:13.022516 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-172a8a9c-d1a4-4f18-880c-19d3ba919a91 req-7d488896-1356-4273-98bb-cc647425b385 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:13.022933 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-172a8a9c-d1a4-4f18-880c-19d3ba919a91 req-7d488896-1356-4273-98bb-cc647425b385 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:13.034907 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-172a8a9c-d1a4-4f18-880c-19d3ba919a91 req-7d488896-1356-4273-98bb-cc647425b385 service nova] Creating event network-changed:156a172c-d9e5-4d86-a0a3-3306c6d3ed53 for instance 1eac07e2-0ca8-4713-b229-c8598c327577 on hv-cinder-85391 Aug 22 05:58:13.040459 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-172a8a9c-d1a4-4f18-880c-19d3ba919a91 req-7d488896-1356-4273-98bb-cc647425b385 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032865 Aug 22 05:58:13.041236 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 598/1183] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:58:13.047394 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b9b03b86-58ef-44c9-bede-087aeba03bbb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:58:13.136905 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b9b03b86-58ef-44c9-bede-087aeba03bbb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 204 len: 0 microversion: 2.1 time: 0.131480 Aug 22 05:58:13.141087 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 586/1184] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:58:13 2022] DELETE /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:58:13.147437 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8167d611-6984-4fbb-8cf4-413fcf6e058a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:58:13.148151 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8167d611-6984-4fbb-8cf4-413fcf6e058a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:58:13.155400 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8167d611-6984-4fbb-8cf4-413fcf6e058a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:13.155909 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8167d611-6984-4fbb-8cf4-413fcf6e058a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:13.156335 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8167d611-6984-4fbb-8cf4-413fcf6e058a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:13.157036 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8167d611-6984-4fbb-8cf4-413fcf6e058a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:13.157477 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8167d611-6984-4fbb-8cf4-413fcf6e058a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:13.157883 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8167d611-6984-4fbb-8cf4-413fcf6e058a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:13.302754 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8167d611-6984-4fbb-8cf4-413fcf6e058a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:58:13.310842 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8167d611-6984-4fbb-8cf4-413fcf6e058a tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1576 microversion: 2.1 time: 0.168142 Aug 22 05:58:13.311443 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 599/1185] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:58:13 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:58:14.334735 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-019da389-d0fb-43ad-a229-52e20ae87b78 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:58:14.335895 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-019da389-d0fb-43ad-a229-52e20ae87b78 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:58:14.347167 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-019da389-d0fb-43ad-a229-52e20ae87b78 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:14.347955 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-019da389-d0fb-43ad-a229-52e20ae87b78 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:14.348629 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-019da389-d0fb-43ad-a229-52e20ae87b78 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:14.349644 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-019da389-d0fb-43ad-a229-52e20ae87b78 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:14.350353 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-019da389-d0fb-43ad-a229-52e20ae87b78 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:14.351018 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-019da389-d0fb-43ad-a229-52e20ae87b78 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:14.565641 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-019da389-d0fb-43ad-a229-52e20ae87b78 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:58:14.576475 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-019da389-d0fb-43ad-a229-52e20ae87b78 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1576 microversion: 2.1 time: 0.247226 Aug 22 05:58:14.577062 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 587/1186] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:58:14 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1576 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:58:15.598155 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-979ef2d1-8c9e-4770-8c59-bfab9bd9f5a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:58:15.598794 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-979ef2d1-8c9e-4770-8c59-bfab9bd9f5a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:58:15.607316 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-979ef2d1-8c9e-4770-8c59-bfab9bd9f5a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:15.608013 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-979ef2d1-8c9e-4770-8c59-bfab9bd9f5a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:15.608581 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-979ef2d1-8c9e-4770-8c59-bfab9bd9f5a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:15.609532 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-979ef2d1-8c9e-4770-8c59-bfab9bd9f5a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:15.610113 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-979ef2d1-8c9e-4770-8c59-bfab9bd9f5a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:15.610526 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-979ef2d1-8c9e-4770-8c59-bfab9bd9f5a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:15.729770 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-979ef2d1-8c9e-4770-8c59-bfab9bd9f5a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:58:15.744129 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-979ef2d1-8c9e-4770-8c59-bfab9bd9f5a0 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 200 len: 1390 microversion: 2.1 time: 0.149706 Aug 22 05:58:15.744795 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 600/1187] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:58:15 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 1390 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:58:15.794435 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-017b2284-ad1e-45f0-b7c7-845ac62b76fc req-8c2ea42b-9e7e-451a-8ef7-60abfc844c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eac07e2-0ca8-4713-b229-c8598c327577", "name": "network-vif-deleted", "tag": "156a172c-d9e5-4d86-a0a3-3306c6d3ed53"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:58:15.806840 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-017b2284-ad1e-45f0-b7c7-845ac62b76fc req-8c2ea42b-9e7e-451a-8ef7-60abfc844c38 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:15.807333 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-017b2284-ad1e-45f0-b7c7-845ac62b76fc req-8c2ea42b-9e7e-451a-8ef7-60abfc844c38 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:15.807775 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-017b2284-ad1e-45f0-b7c7-845ac62b76fc req-8c2ea42b-9e7e-451a-8ef7-60abfc844c38 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:15.821197 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-017b2284-ad1e-45f0-b7c7-845ac62b76fc req-8c2ea42b-9e7e-451a-8ef7-60abfc844c38 service nova] Creating event network-vif-deleted:156a172c-d9e5-4d86-a0a3-3306c6d3ed53 for instance 1eac07e2-0ca8-4713-b229-c8598c327577 on hv-cinder-85391 Aug 22 05:58:15.827091 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-017b2284-ad1e-45f0-b7c7-845ac62b76fc req-8c2ea42b-9e7e-451a-8ef7-60abfc844c38 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037083 Aug 22 05:58:15.827745 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 588/1188] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:58:16.768677 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-736adf6b-ab49-4ba1-9b13-351e2c4a2f0f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:58:16.769497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-736adf6b-ab49-4ba1-9b13-351e2c4a2f0f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 1eac07e2-0ca8-4713-b229-c8598c327577] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:58:16.780281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-736adf6b-ab49-4ba1-9b13-351e2c4a2f0f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:16.781185 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-736adf6b-ab49-4ba1-9b13-351e2c4a2f0f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:16.781784 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-736adf6b-ab49-4ba1-9b13-351e2c4a2f0f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:16.782882 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-736adf6b-ab49-4ba1-9b13-351e2c4a2f0f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:16.783566 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-736adf6b-ab49-4ba1-9b13-351e2c4a2f0f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:16.784246 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-736adf6b-ab49-4ba1-9b13-351e2c4a2f0f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:16.801235 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-736adf6b-ab49-4ba1-9b13-351e2c4a2f0f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] HTTP exception thrown: Instance 1eac07e2-0ca8-4713-b229-c8598c327577 could not be found. Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-736adf6b-ab49-4ba1-9b13-351e2c4a2f0f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Request method failure captured: Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 HTTP/1.1 Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxj9WcOCDiLZOGhHqYXlJYzqSdD-Nl-Bk9l-DEeqx3O4nIC3myVhi19DiJ3kmU3m1ZUv4yq_gciqCLOoekRlgMfBLXBLnKhpp3s_lAMpZzlN7KONEbkBZMcMmnHBSDxMxjs-xyzX8b3a7bBHHdHThuaEtflzSwAsbu3-Sk1cr48AUtg Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: 6d3a9f50ec2d4fff938fcd6a79f5cdc9 Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-TestVolumeBootPattern-130227501 Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:58:16.802864 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:58:16.804647 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6d3a9f50ec2d4fff938fcd6a79f5cdc9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d3a9f50ec2d4fff938fcd6a79f5cdc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d3a9f50ec2d4fff938fcd6a79f5cdc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6d3a9f50ec2d4fff938fcd6a79f5cdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:58:16.804647 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-TestVolumeBootPattern-130227501 Aug 22 05:58:16.804647 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: 6d3a9f50ec2d4fff938fcd6a79f5cdc9 Aug 22 05:58:16.804647 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-TestVolumeBootPattern-130227501 Aug 22 05:58:16.804647 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-TestVolumeBootPattern-130227501-project Aug 22 05:58:16.804647 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:58:16.804647 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:58:16.804647 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: bb6d35f57b804ba5afa4ab86c46cd7c3 Aug 22 05:58:16.804647 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-TestVolumeBootPattern-130227501-project Aug 22 05:58:16.804647 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:58:16.804647 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance 1eac07e2-0ca8-4713-b229-c8598c327577 could not be found. Aug 22 05:58:16.804647 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': '1eac07e2-0ca8-4713-b229-c8598c327577'} Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eac07e2-0ca8-4713-b229-c8598c327577 could not be found. Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:58:16.806463 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eac07e2-0ca8-4713-b229-c8598c327577 could not be found. Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eac07e2-0ca8-4713-b229-c8598c327577 could not be found. Aug 22 05:58:16.808281 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:58:16.809712 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-736adf6b-ab49-4ba1-9b13-351e2c4a2f0f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Returning 404 to user: Instance 1eac07e2-0ca8-4713-b229-c8598c327577 could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:58:16.809712 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-736adf6b-ab49-4ba1-9b13-351e2c4a2f0f tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577" status: 404 len: 111 microversion: 2.1 time: 0.041028 Aug 22 05:58:16.809712 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 601/1189] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:58:16 2022] GET /compute/v2.1/servers/1eac07e2-0ca8-4713-b229-c8598c327577 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:58:19.916409 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-017ae583-f265-48b2-beca-fb861d404d47 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:58:19.917042 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-017ae583-f265-48b2-beca-fb861d404d47 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:58:19.918086 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-9780fdbe-3876-496d-8e6f-5bd30fb927ff req-6359309d-4361-486a-8da5-71341b709d50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27f5503f-65ce-4e35-8184-6fe3a457f78f", "tag": "b090e134-f7c1-451f-a8db-bbebbb63e01e"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:58:19.923898 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-017ae583-f265-48b2-beca-fb861d404d47 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:19.924379 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-017ae583-f265-48b2-beca-fb861d404d47 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:19.924810 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-017ae583-f265-48b2-beca-fb861d404d47 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:19.925489 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-017ae583-f265-48b2-beca-fb861d404d47 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:19.926104 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-017ae583-f265-48b2-beca-fb861d404d47 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:19.926684 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-017ae583-f265-48b2-beca-fb861d404d47 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:19.929865 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-9780fdbe-3876-496d-8e6f-5bd30fb927ff req-6359309d-4361-486a-8da5-71341b709d50 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:19.930555 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-9780fdbe-3876-496d-8e6f-5bd30fb927ff req-6359309d-4361-486a-8da5-71341b709d50 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:19.930976 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-9780fdbe-3876-496d-8e6f-5bd30fb927ff req-6359309d-4361-486a-8da5-71341b709d50 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:19.944424 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-9780fdbe-3876-496d-8e6f-5bd30fb927ff req-6359309d-4361-486a-8da5-71341b709d50 service nova] Creating event network-changed:b090e134-f7c1-451f-a8db-bbebbb63e01e for instance 27f5503f-65ce-4e35-8184-6fe3a457f78f on hv-cinder-85391 Aug 22 05:58:19.950093 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-9780fdbe-3876-496d-8e6f-5bd30fb927ff req-6359309d-4361-486a-8da5-71341b709d50 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036371 Aug 22 05:58:19.951497 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 602/1190] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:58:19.954693 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-017ae583-f265-48b2-beca-fb861d404d47 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 05:58:20.046232 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-017ae583-f265-48b2-beca-fb861d404d47 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "DELETE /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 204 len: 0 microversion: 2.1 time: 0.134738 Aug 22 05:58:20.047023 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 589/1191] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:58:19 2022] DELETE /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 05:58:20.059337 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8e79f061-a6f1-4d0b-a73f-beca7081cab8 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:58:20.061060 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8e79f061-a6f1-4d0b-a73f-beca7081cab8 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:58:20.070594 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e79f061-a6f1-4d0b-a73f-beca7081cab8 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:20.072088 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e79f061-a6f1-4d0b-a73f-beca7081cab8 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:20.072891 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e79f061-a6f1-4d0b-a73f-beca7081cab8 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:20.073884 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e79f061-a6f1-4d0b-a73f-beca7081cab8 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:20.074487 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e79f061-a6f1-4d0b-a73f-beca7081cab8 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:20.075068 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8e79f061-a6f1-4d0b-a73f-beca7081cab8 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:20.225116 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8e79f061-a6f1-4d0b-a73f-beca7081cab8 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:58:20.234410 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8e79f061-a6f1-4d0b-a73f-beca7081cab8 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1575 microversion: 2.1 time: 0.182234 Aug 22 05:58:20.248869 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 603/1192] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:58:20 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1575 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:58:20.831357 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 05:58:20.831804 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Mon Aug 22 05:58:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 05:58:21.257419 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-447e4e75-a361-44a4-ac8a-1eb55f0a4b1b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:58:21.258185 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-447e4e75-a361-44a4-ac8a-1eb55f0a4b1b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:58:21.264946 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-447e4e75-a361-44a4-ac8a-1eb55f0a4b1b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:21.265474 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-447e4e75-a361-44a4-ac8a-1eb55f0a4b1b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:21.265930 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-447e4e75-a361-44a4-ac8a-1eb55f0a4b1b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:21.266644 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-447e4e75-a361-44a4-ac8a-1eb55f0a4b1b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:21.267092 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-447e4e75-a361-44a4-ac8a-1eb55f0a4b1b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:21.267512 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-447e4e75-a361-44a4-ac8a-1eb55f0a4b1b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:21.335029 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-447e4e75-a361-44a4-ac8a-1eb55f0a4b1b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d35f57b804ba5afa4ab86c46cd7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3a9f50ec2d4fff938fcd6a79f5cdc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:58:21.344492 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-447e4e75-a361-44a4-ac8a-1eb55f0a4b1b tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 200 len: 1225 microversion: 2.1 time: 0.091350 Aug 22 05:58:21.345126 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 590/1193] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:58:21 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:58:21.966559 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-0c3a1af6-5c73-4b25-982b-57ab63ffdf4c req-63ff46f4-ed51-4dbc-ab15-e3377e91e94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27f5503f-65ce-4e35-8184-6fe3a457f78f", "name": "network-vif-deleted", "tag": "b090e134-f7c1-451f-a8db-bbebbb63e01e"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:58:21.976911 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-0c3a1af6-5c73-4b25-982b-57ab63ffdf4c req-63ff46f4-ed51-4dbc-ab15-e3377e91e94a service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:21.977371 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-0c3a1af6-5c73-4b25-982b-57ab63ffdf4c req-63ff46f4-ed51-4dbc-ab15-e3377e91e94a service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:21.977787 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-0c3a1af6-5c73-4b25-982b-57ab63ffdf4c req-63ff46f4-ed51-4dbc-ab15-e3377e91e94a service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:21.989553 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-0c3a1af6-5c73-4b25-982b-57ab63ffdf4c req-63ff46f4-ed51-4dbc-ab15-e3377e91e94a service nova] Creating event network-vif-deleted:b090e134-f7c1-451f-a8db-bbebbb63e01e for instance 27f5503f-65ce-4e35-8184-6fe3a457f78f on hv-cinder-85391 Aug 22 05:58:21.995112 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-0c3a1af6-5c73-4b25-982b-57ab63ffdf4c req-63ff46f4-ed51-4dbc-ab15-e3377e91e94a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032583 Aug 22 05:58:21.995767 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 604/1194] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 05:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 05:58:22.369713 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ac99992c-a739-481b-bbfe-c2cd90964a66 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:58:22.370594 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ac99992c-a739-481b-bbfe-c2cd90964a66 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: 27f5503f-65ce-4e35-8184-6fe3a457f78f] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:58:22.378396 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ac99992c-a739-481b-bbfe-c2cd90964a66 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:22.378866 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ac99992c-a739-481b-bbfe-c2cd90964a66 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:22.379292 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ac99992c-a739-481b-bbfe-c2cd90964a66 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:22.380005 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ac99992c-a739-481b-bbfe-c2cd90964a66 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:22.380442 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ac99992c-a739-481b-bbfe-c2cd90964a66 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:22.380867 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ac99992c-a739-481b-bbfe-c2cd90964a66 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:22.394725 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-ac99992c-a739-481b-bbfe-c2cd90964a66 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] HTTP exception thrown: Instance 27f5503f-65ce-4e35-8184-6fe3a457f78f could not be found. Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ac99992c-a739-481b-bbfe-c2cd90964a66 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Request method failure captured: Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f HTTP/1.1 Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxj9WcOCDiLZOGhHqYXlJYzqSdD-Nl-Bk9l-DEeqx3O4nIC3myVhi19DiJ3kmU3m1ZUv4yq_gciqCLOoekRlgMfBLXBLnKhpp3s_lAMpZzlN7KONEbkBZMcMmnHBSDxMxjs-xyzX8b3a7bBHHdHThuaEtflzSwAsbu3-Sk1cr48AUtg Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 6d3a9f50ec2d4fff938fcd6a79f5cdc9 Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-TestVolumeBootPattern-130227501 Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:58:22.396403 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:58:22.398118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6d3a9f50ec2d4fff938fcd6a79f5cdc9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d3a9f50ec2d4fff938fcd6a79f5cdc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d3a9f50ec2d4fff938fcd6a79f5cdc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6d3a9f50ec2d4fff938fcd6a79f5cdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:58:22.398118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-TestVolumeBootPattern-130227501 Aug 22 05:58:22.398118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 6d3a9f50ec2d4fff938fcd6a79f5cdc9 Aug 22 05:58:22.398118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-TestVolumeBootPattern-130227501 Aug 22 05:58:22.398118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-TestVolumeBootPattern-130227501-project Aug 22 05:58:22.398118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:58:22.398118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:58:22.398118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: bb6d35f57b804ba5afa4ab86c46cd7c3 Aug 22 05:58:22.398118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-TestVolumeBootPattern-130227501-project Aug 22 05:58:22.398118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:58:22.398118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 27f5503f-65ce-4e35-8184-6fe3a457f78f could not be found. Aug 22 05:58:22.398118 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '27f5503f-65ce-4e35-8184-6fe3a457f78f'} Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27f5503f-65ce-4e35-8184-6fe3a457f78f could not be found. Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:58:22.399079 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27f5503f-65ce-4e35-8184-6fe3a457f78f could not be found. Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27f5503f-65ce-4e35-8184-6fe3a457f78f could not be found. Aug 22 05:58:22.400711 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:58:22.402149 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ac99992c-a739-481b-bbfe-c2cd90964a66 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Returning 404 to user: Instance 27f5503f-65ce-4e35-8184-6fe3a457f78f could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:58:22.402149 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ac99992c-a739-481b-bbfe-c2cd90964a66 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f" status: 404 len: 111 microversion: 2.1 time: 0.034836 Aug 22 05:58:22.402149 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 591/1195] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:58:22 2022] GET /compute/v2.1/servers/27f5503f-65ce-4e35-8184-6fe3a457f78f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:58:22.869970 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a3567068-3b2c-44a9-b91e-2ecabda23542 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:58:22.870561 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a3567068-3b2c-44a9-b91e-2ecabda23542 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:58:22.877710 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3567068-3b2c-44a9-b91e-2ecabda23542 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:22.878182 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3567068-3b2c-44a9-b91e-2ecabda23542 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:22.878617 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3567068-3b2c-44a9-b91e-2ecabda23542 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:22.879301 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3567068-3b2c-44a9-b91e-2ecabda23542 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:22.879780 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3567068-3b2c-44a9-b91e-2ecabda23542 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:22.880195 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a3567068-3b2c-44a9-b91e-2ecabda23542 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:22.893756 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.wsgi [None req-a3567068-3b2c-44a9-b91e-2ecabda23542 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] HTTP exception thrown: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a3567068-3b2c-44a9-b91e-2ecabda23542 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Request method failure captured: Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: request: DELETE /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 HTTP/1.1 Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept: application/json Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Accept-Encoding: identity Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Connection: close Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Length: 0 Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Content-Type: application/json Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Host: 10.222.0.18 Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Openstack-System-Scope: None Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: User-Agent: python-urllib3/1.26.11 Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Auth-Token: gAAAAABjAxj9WcOCDiLZOGhHqYXlJYzqSdD-Nl-Bk9l-DEeqx3O4nIC3myVhi19DiJ3kmU3m1ZUv4yq_gciqCLOoekRlgMfBLXBLnKhpp3s_lAMpZzlN7KONEbkBZMcMmnHBSDxMxjs-xyzX8b3a7bBHHdHThuaEtflzSwAsbu3-Sk1cr48AUtg Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Id: None Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Domain-Name: None Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Identity-Status: Confirmed Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Is-Admin-Project: True Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Id: default Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Domain-Name: Default Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Id: 6d3a9f50ec2d4fff938fcd6a79f5cdc9 Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Project-Name: tempest-TestVolumeBootPattern-130227501 Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Role: member,reader Aug 22 05:58:22.895381 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Roles: member,reader Aug 22 05:58:22.897099 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6d3a9f50ec2d4fff938fcd6a79f5cdc9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d3a9f50ec2d4fff938fcd6a79f5cdc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d3a9f50ec2d4fff938fcd6a79f5cdc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6d3a9f50ec2d4fff938fcd6a79f5cdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:58:22.897099 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant: tempest-TestVolumeBootPattern-130227501 Aug 22 05:58:22.897099 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Id: 6d3a9f50ec2d4fff938fcd6a79f5cdc9 Aug 22 05:58:22.897099 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-Tenant-Name: tempest-TestVolumeBootPattern-130227501 Aug 22 05:58:22.897099 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User: tempest-TestVolumeBootPattern-130227501-project Aug 22 05:58:22.897099 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Id: default Aug 22 05:58:22.897099 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Domain-Name: Default Aug 22 05:58:22.897099 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Id: bb6d35f57b804ba5afa4ab86c46cd7c3 Aug 22 05:58:22.897099 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: X-User-Name: tempest-TestVolumeBootPattern-130227501-project Aug 22 05:58:22.897099 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: method: > Aug 22 05:58:22.897099 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: exception: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. Aug 22 05:58:22.897099 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: action_args: {'id': 'c38dec1b-72b3-49d9-a7cc-aeb7883bae61'} Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:58:22.898007 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. Aug 22 05:58:22.899527 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: ERROR nova.api.openstack.wsgi Aug 22 05:58:22.903423 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a3567068-3b2c-44a9-b91e-2ecabda23542 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Returning 404 to user: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. {{(pid=132497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:58:22.903423 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a3567068-3b2c-44a9-b91e-2ecabda23542 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 404 len: 111 microversion: 2.1 time: 0.031263 Aug 22 05:58:22.903423 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 605/1196] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 05:58:22 2022] DELETE /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:58:22.906879 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b60a065a-4eff-4b3b-9381-9f3e9d3d5edb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:58:22.907518 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b60a065a-4eff-4b3b-9381-9f3e9d3d5edb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] [instance: c38dec1b-72b3-49d9-a7cc-aeb7883bae61] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:58:22.913803 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b60a065a-4eff-4b3b-9381-9f3e9d3d5edb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:22.914276 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b60a065a-4eff-4b3b-9381-9f3e9d3d5edb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:22.914705 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b60a065a-4eff-4b3b-9381-9f3e9d3d5edb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:22.915386 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b60a065a-4eff-4b3b-9381-9f3e9d3d5edb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:58:22.915868 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b60a065a-4eff-4b3b-9381-9f3e9d3d5edb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:58:22.916281 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b60a065a-4eff-4b3b-9381-9f3e9d3d5edb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:58:22.930741 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-b60a065a-4eff-4b3b-9381-9f3e9d3d5edb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] HTTP exception thrown: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b60a065a-4eff-4b3b-9381-9f3e9d3d5edb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Request method failure captured: Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 HTTP/1.1 Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxj9WcOCDiLZOGhHqYXlJYzqSdD-Nl-Bk9l-DEeqx3O4nIC3myVhi19DiJ3kmU3m1ZUv4yq_gciqCLOoekRlgMfBLXBLnKhpp3s_lAMpZzlN7KONEbkBZMcMmnHBSDxMxjs-xyzX8b3a7bBHHdHThuaEtflzSwAsbu3-Sk1cr48AUtg Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 6d3a9f50ec2d4fff938fcd6a79f5cdc9 Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-TestVolumeBootPattern-130227501 Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 05:58:22.932356 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 05:58:22.934035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6d3a9f50ec2d4fff938fcd6a79f5cdc9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d3a9f50ec2d4fff938fcd6a79f5cdc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d3a9f50ec2d4fff938fcd6a79f5cdc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6d3a9f50ec2d4fff938fcd6a79f5cdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 05:58:22.934035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-TestVolumeBootPattern-130227501 Aug 22 05:58:22.934035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 6d3a9f50ec2d4fff938fcd6a79f5cdc9 Aug 22 05:58:22.934035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-TestVolumeBootPattern-130227501 Aug 22 05:58:22.934035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-TestVolumeBootPattern-130227501-project Aug 22 05:58:22.934035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 05:58:22.934035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 05:58:22.934035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: bb6d35f57b804ba5afa4ab86c46cd7c3 Aug 22 05:58:22.934035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-TestVolumeBootPattern-130227501-project Aug 22 05:58:22.934035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 05:58:22.934035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. Aug 22 05:58:22.934035 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': 'c38dec1b-72b3-49d9-a7cc-aeb7883bae61'} Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 05:58:22.935080 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. Aug 22 05:58:22.937056 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 05:58:22.938453 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b60a065a-4eff-4b3b-9381-9f3e9d3d5edb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Returning 404 to user: Instance c38dec1b-72b3-49d9-a7cc-aeb7883bae61 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 05:58:22.938453 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b60a065a-4eff-4b3b-9381-9f3e9d3d5edb tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61" status: 404 len: 111 microversion: 2.1 time: 0.031815 Aug 22 05:58:22.938453 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 592/1197] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:58:22 2022] GET /compute/v2.1/servers/c38dec1b-72b3-49d9-a7cc-aeb7883bae61 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 05:58:24.249261 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-7692ab9f-a1ed-48e0-bb95-6d841a399591 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] Calling method '.version_select at 0x7f0b3e02fdc0>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:58:24.270237 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-7692ab9f-a1ed-48e0-bb95-6d841a399591 tempest-TestVolumeBootPattern-130227501 tempest-TestVolumeBootPattern-130227501-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1539589973" status: 202 len: 0 microversion: 2.1 time: 0.025339 Aug 22 05:58:24.274153 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 606/1198] 10.222.0.18 () {58 vars in 1263 bytes} [Mon Aug 22 05:58:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1539589973 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:59:00.968857 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4b00ea2d-d710-4924-9409-a89dffd0833a tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 05:59:00.971901 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4b00ea2d-d710-4924-9409-a89dffd0833a tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:59:00.974749 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:59:00.975401 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:59:00.982090 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b00ea2d-d710-4924-9409-a89dffd0833a tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:00.982600 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b00ea2d-d710-4924-9409-a89dffd0833a tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:00.983040 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b00ea2d-d710-4924-9409-a89dffd0833a tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:00.983757 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b00ea2d-d710-4924-9409-a89dffd0833a tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:00.984203 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b00ea2d-d710-4924-9409-a89dffd0833a tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:00.984608 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b00ea2d-d710-4924-9409-a89dffd0833a tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:01.068641 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4b00ea2d-d710-4924-9409-a89dffd0833a tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "POST /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/action" status: 202 len: 0 microversion: 2.1 time: 0.106161 Aug 22 05:59:01.069349 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 593/1199] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 22 05:59:00 2022] POST /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 05:59:01.077468 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-38cdc1f6-0b96-4c78-90e5-fb595120ef16 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:59:01.078061 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-38cdc1f6-0b96-4c78-90e5-fb595120ef16 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:59:01.080451 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=31 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:59:01.081214 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:59:01.088388 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-38cdc1f6-0b96-4c78-90e5-fb595120ef16 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:01.089247 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-38cdc1f6-0b96-4c78-90e5-fb595120ef16 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:01.089676 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-38cdc1f6-0b96-4c78-90e5-fb595120ef16 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:01.090384 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-38cdc1f6-0b96-4c78-90e5-fb595120ef16 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:01.090830 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-38cdc1f6-0b96-4c78-90e5-fb595120ef16 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:01.091251 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-38cdc1f6-0b96-4c78-90e5-fb595120ef16 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:01.240251 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-38cdc1f6-0b96-4c78-90e5-fb595120ef16 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:59:01.248912 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-38cdc1f6-0b96-4c78-90e5-fb595120ef16 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1751 microversion: 2.1 time: 0.175243 Aug 22 05:59:01.249478 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 607/1200] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:59:01 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:59:02.272046 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-02273d5c-35d0-46f4-a712-144515b76ee4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:59:02.272766 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-02273d5c-35d0-46f4-a712-144515b76ee4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:59:02.279556 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-02273d5c-35d0-46f4-a712-144515b76ee4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:02.280067 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-02273d5c-35d0-46f4-a712-144515b76ee4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:02.280500 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-02273d5c-35d0-46f4-a712-144515b76ee4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:02.281188 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-02273d5c-35d0-46f4-a712-144515b76ee4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:02.281636 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-02273d5c-35d0-46f4-a712-144515b76ee4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:02.282048 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-02273d5c-35d0-46f4-a712-144515b76ee4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:02.436376 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-02273d5c-35d0-46f4-a712-144515b76ee4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:59:02.445459 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-02273d5c-35d0-46f4-a712-144515b76ee4 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1756 microversion: 2.1 time: 0.178423 Aug 22 05:59:02.446039 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 594/1201] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:59:02 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:59:03.478927 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-af32ca30-6987-4970-8592-cf6c14050f15 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:59:03.479964 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-af32ca30-6987-4970-8592-cf6c14050f15 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:59:03.490741 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-af32ca30-6987-4970-8592-cf6c14050f15 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:03.491213 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-af32ca30-6987-4970-8592-cf6c14050f15 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:03.491679 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-af32ca30-6987-4970-8592-cf6c14050f15 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:03.492363 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-af32ca30-6987-4970-8592-cf6c14050f15 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:03.492802 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-af32ca30-6987-4970-8592-cf6c14050f15 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:03.493215 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-af32ca30-6987-4970-8592-cf6c14050f15 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:03.650967 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-af32ca30-6987-4970-8592-cf6c14050f15 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:59:03.662053 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-af32ca30-6987-4970-8592-cf6c14050f15 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1756 microversion: 2.1 time: 0.189701 Aug 22 05:59:03.662652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 608/1202] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:59:03 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:59:04.688696 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2b6f86a2-45f7-4321-82d5-e3a37e4588bc tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:59:04.689671 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2b6f86a2-45f7-4321-82d5-e3a37e4588bc tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:59:04.700972 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b6f86a2-45f7-4321-82d5-e3a37e4588bc tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:04.701759 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b6f86a2-45f7-4321-82d5-e3a37e4588bc tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:04.702463 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b6f86a2-45f7-4321-82d5-e3a37e4588bc tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:04.703616 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b6f86a2-45f7-4321-82d5-e3a37e4588bc tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:04.704359 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b6f86a2-45f7-4321-82d5-e3a37e4588bc tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:04.705043 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b6f86a2-45f7-4321-82d5-e3a37e4588bc tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:04.861321 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2b6f86a2-45f7-4321-82d5-e3a37e4588bc tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:59:04.870448 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2b6f86a2-45f7-4321-82d5-e3a37e4588bc tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1756 microversion: 2.1 time: 0.188378 Aug 22 05:59:04.870984 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 595/1203] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:59:04 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:59:05.897233 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-9a056b34-3ec9-4a2f-a157-5db6c4162861 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:59:05.899077 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-9a056b34-3ec9-4a2f-a157-5db6c4162861 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:59:05.911729 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9a056b34-3ec9-4a2f-a157-5db6c4162861 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:05.911913 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9a056b34-3ec9-4a2f-a157-5db6c4162861 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:05.912247 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9a056b34-3ec9-4a2f-a157-5db6c4162861 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:05.912939 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9a056b34-3ec9-4a2f-a157-5db6c4162861 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:05.913378 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9a056b34-3ec9-4a2f-a157-5db6c4162861 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:05.913790 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9a056b34-3ec9-4a2f-a157-5db6c4162861 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:06.060436 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-9a056b34-3ec9-4a2f-a157-5db6c4162861 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:59:06.069356 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-9a056b34-3ec9-4a2f-a157-5db6c4162861 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1756 microversion: 2.1 time: 0.179596 Aug 22 05:59:06.069932 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 609/1204] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:59:05 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:59:07.094895 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b8dbf5bd-d2de-4537-b523-f8d019a70ddd tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:59:07.095870 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b8dbf5bd-d2de-4537-b523-f8d019a70ddd tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:59:07.106875 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b8dbf5bd-d2de-4537-b523-f8d019a70ddd tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:07.107668 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b8dbf5bd-d2de-4537-b523-f8d019a70ddd tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:07.108468 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b8dbf5bd-d2de-4537-b523-f8d019a70ddd tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:07.109589 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b8dbf5bd-d2de-4537-b523-f8d019a70ddd tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:07.110325 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b8dbf5bd-d2de-4537-b523-f8d019a70ddd tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:07.111015 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b8dbf5bd-d2de-4537-b523-f8d019a70ddd tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:07.260399 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b8dbf5bd-d2de-4537-b523-f8d019a70ddd tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:59:07.272038 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b8dbf5bd-d2de-4537-b523-f8d019a70ddd tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1756 microversion: 2.1 time: 0.184109 Aug 22 05:59:07.272606 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 596/1205] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:59:07 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:59:08.295418 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-55d88429-6cf6-412d-80a2-63506b86b902 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:59:08.296150 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-55d88429-6cf6-412d-80a2-63506b86b902 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:59:08.305377 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-55d88429-6cf6-412d-80a2-63506b86b902 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:08.306016 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-55d88429-6cf6-412d-80a2-63506b86b902 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:08.306613 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-55d88429-6cf6-412d-80a2-63506b86b902 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:08.307518 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-55d88429-6cf6-412d-80a2-63506b86b902 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:08.308192 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-55d88429-6cf6-412d-80a2-63506b86b902 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:08.308768 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-55d88429-6cf6-412d-80a2-63506b86b902 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:08.468958 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-55d88429-6cf6-412d-80a2-63506b86b902 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:59:08.477682 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-55d88429-6cf6-412d-80a2-63506b86b902 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1756 microversion: 2.1 time: 0.187543 Aug 22 05:59:08.478237 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 610/1206] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:59:08 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:59:09.506402 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-efc5f807-1024-4f55-a54a-6a99370afb01 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:59:09.507338 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-efc5f807-1024-4f55-a54a-6a99370afb01 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:59:09.518462 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-efc5f807-1024-4f55-a54a-6a99370afb01 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:09.519386 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-efc5f807-1024-4f55-a54a-6a99370afb01 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:09.520292 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-efc5f807-1024-4f55-a54a-6a99370afb01 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:09.521151 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-efc5f807-1024-4f55-a54a-6a99370afb01 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:09.521649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-efc5f807-1024-4f55-a54a-6a99370afb01 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:09.522089 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-efc5f807-1024-4f55-a54a-6a99370afb01 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:09.669733 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-efc5f807-1024-4f55-a54a-6a99370afb01 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:59:09.682203 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-efc5f807-1024-4f55-a54a-6a99370afb01 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1756 microversion: 2.1 time: 0.182529 Aug 22 05:59:09.683015 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 597/1207] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:59:09 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:59:10.710856 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-8323f474-d00c-4495-98cf-50ff487883a5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:59:10.711946 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-8323f474-d00c-4495-98cf-50ff487883a5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:59:10.720087 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8323f474-d00c-4495-98cf-50ff487883a5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:10.720560 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8323f474-d00c-4495-98cf-50ff487883a5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:10.720973 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8323f474-d00c-4495-98cf-50ff487883a5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:10.721645 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8323f474-d00c-4495-98cf-50ff487883a5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:10.722077 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8323f474-d00c-4495-98cf-50ff487883a5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:10.722519 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-8323f474-d00c-4495-98cf-50ff487883a5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:10.885261 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-8323f474-d00c-4495-98cf-50ff487883a5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:59:10.894905 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-8323f474-d00c-4495-98cf-50ff487883a5 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1756 microversion: 2.1 time: 0.190369 Aug 22 05:59:10.895524 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 611/1208] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:59:10 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:59:11.917168 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4eb0c1fd-85b1-4e11-ba18-e12c6552c5cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:59:11.917737 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4eb0c1fd-85b1-4e11-ba18-e12c6552c5cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:59:11.925029 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4eb0c1fd-85b1-4e11-ba18-e12c6552c5cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:11.925504 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4eb0c1fd-85b1-4e11-ba18-e12c6552c5cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:11.925927 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4eb0c1fd-85b1-4e11-ba18-e12c6552c5cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:11.926617 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4eb0c1fd-85b1-4e11-ba18-e12c6552c5cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:11.927055 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4eb0c1fd-85b1-4e11-ba18-e12c6552c5cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:11.927470 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4eb0c1fd-85b1-4e11-ba18-e12c6552c5cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:12.089025 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4eb0c1fd-85b1-4e11-ba18-e12c6552c5cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:59:12.101015 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4eb0c1fd-85b1-4e11-ba18-e12c6552c5cf tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1756 microversion: 2.1 time: 0.187677 Aug 22 05:59:12.101886 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 598/1209] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:59:11 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:59:13.133212 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a15718df-a792-4d89-b74d-1c1269afef97 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 05:59:13.134250 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a15718df-a792-4d89-b74d-1c1269afef97 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 05:59:13.144974 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a15718df-a792-4d89-b74d-1c1269afef97 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:13.145828 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a15718df-a792-4d89-b74d-1c1269afef97 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:13.146560 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a15718df-a792-4d89-b74d-1c1269afef97 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:13.147734 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a15718df-a792-4d89-b74d-1c1269afef97 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 05:59:13.148495 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a15718df-a792-4d89-b74d-1c1269afef97 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 05:59:13.149282 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a15718df-a792-4d89-b74d-1c1269afef97 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 05:59:13.306903 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a15718df-a792-4d89-b74d-1c1269afef97 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 05:59:13.315313 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a15718df-a792-4d89-b74d-1c1269afef97 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1759 microversion: 2.1 time: 0.188848 Aug 22 05:59:13.315892 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 612/1210] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 05:59:13 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1759 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 05:59:27.354648 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 05:59:27.356106 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Mon Aug 22 05:59:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 06:00:02.008321 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-80993b0f-8a0b-4942-97a0-1d84e846d56d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1746893917"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 06:00:02.009102 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-80993b0f-8a0b-4942-97a0-1d84e846d56d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 06:00:02.012743 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=12 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 06:00:02.013435 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 06:00:02.018408 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80993b0f-8a0b-4942-97a0-1d84e846d56d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:02.018934 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80993b0f-8a0b-4942-97a0-1d84e846d56d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:02.019419 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80993b0f-8a0b-4942-97a0-1d84e846d56d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:02.020294 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80993b0f-8a0b-4942-97a0-1d84e846d56d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:02.020792 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80993b0f-8a0b-4942-97a0-1d84e846d56d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:02.021257 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80993b0f-8a0b-4942-97a0-1d84e846d56d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:02.156919 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.network.security_group_api [None req-80993b0f-8a0b-4942-97a0-1d84e846d56d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Removing security group 1fec6425-7849-4d6d-9cd9-c34746865995 from port bb2d58f3-53b0-416d-9d06-3975fcbcd318 Aug 22 06:00:02.482989 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-80993b0f-8a0b-4942-97a0-1d84e846d56d tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "POST /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/action" status: 202 len: 0 microversion: 2.1 time: 0.480531 Aug 22 06:00:02.483789 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 599/1211] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 22 06:00:02 2022] POST /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 06:00:02.493328 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [req-c19c82be-d0c2-4c32-876d-1fed3ffaf902 req-a14807c1-6d4a-4d14-abbc-cf6431bcd044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ea9c57-9074-4057-b7b2-9d27deb95268", "tag": "bb2d58f3-53b0-416d-9d06-3975fcbcd318"}]} {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 06:00:02.503667 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_api:SELECT=12 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 06:00:02.504708 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG dbcounter [-] [132497] Writing DB stats nova_cell1:SELECT=36 {{(pid=132497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 06:00:02.507241 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-c19c82be-d0c2-4c32-876d-1fed3ffaf902 req-a14807c1-6d4a-4d14-abbc-cf6431bcd044 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:02.508254 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-c19c82be-d0c2-4c32-876d-1fed3ffaf902 req-a14807c1-6d4a-4d14-abbc-cf6431bcd044 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:02.508929 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [req-c19c82be-d0c2-4c32-876d-1fed3ffaf902 req-a14807c1-6d4a-4d14-abbc-cf6431bcd044 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:02.525320 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.compute.server_external_events [req-c19c82be-d0c2-4c32-876d-1fed3ffaf902 req-a14807c1-6d4a-4d14-abbc-cf6431bcd044 service nova] Creating event network-changed:bb2d58f3-53b0-416d-9d06-3975fcbcd318 for instance 13ea9c57-9074-4057-b7b2-9d27deb95268 on hv-cinder-85391 Aug 22 06:00:02.533364 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [req-c19c82be-d0c2-4c32-876d-1fed3ffaf902 req-a14807c1-6d4a-4d14-abbc-cf6431bcd044 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044044 Aug 22 06:00:02.534777 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 613/1212] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 06:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 06:00:03.580902 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-80b5a13e-1022-4b64-955a-c392c0467a51 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 06:00:03.581518 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-80b5a13e-1022-4b64-955a-c392c0467a51 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 06:00:03.587608 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80b5a13e-1022-4b64-955a-c392c0467a51 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:03.588165 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80b5a13e-1022-4b64-955a-c392c0467a51 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:03.588957 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80b5a13e-1022-4b64-955a-c392c0467a51 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:03.589647 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80b5a13e-1022-4b64-955a-c392c0467a51 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:03.590088 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80b5a13e-1022-4b64-955a-c392c0467a51 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:03.590532 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80b5a13e-1022-4b64-955a-c392c0467a51 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:03.677491 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-80b5a13e-1022-4b64-955a-c392c0467a51 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lazy-loading 'services' on Instance uuid 13ea9c57-9074-4057-b7b2-9d27deb95268 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 06:00:03.752932 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-80b5a13e-1022-4b64-955a-c392c0467a51 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "DELETE /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/os-volume_attachments/8b89b366-7826-4f17-8494-67bb5acadbf7" status: 202 len: 0 microversion: 2.1 time: 0.176314 Aug 22 06:00:03.753783 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 600/1213] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 22 06:00:03 2022] DELETE /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/os-volume_attachments/8b89b366-7826-4f17-8494-67bb5acadbf7 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 06:00:03.763241 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-2084ca13-74c6-4364-a9d5-5deddadf11a3 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 06:00:03.765554 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-2084ca13-74c6-4364-a9d5-5deddadf11a3 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 06:00:03.773120 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2084ca13-74c6-4364-a9d5-5deddadf11a3 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:03.773602 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2084ca13-74c6-4364-a9d5-5deddadf11a3 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:03.774031 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2084ca13-74c6-4364-a9d5-5deddadf11a3 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:03.774736 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2084ca13-74c6-4364-a9d5-5deddadf11a3 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:03.775371 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2084ca13-74c6-4364-a9d5-5deddadf11a3 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:03.775852 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-2084ca13-74c6-4364-a9d5-5deddadf11a3 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:03.808094 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-2084ca13-74c6-4364-a9d5-5deddadf11a3 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049627 Aug 22 06:00:03.808727 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 614/1214] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 22 06:00:03 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 06:00:04.568926 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-34127d7a-9368-4830-81d6-dc0a59efadcd req-e7463dd0-c976-4662-b72e-3ba6e9ff29f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ea9c57-9074-4057-b7b2-9d27deb95268", "tag": "bb2d58f3-53b0-416d-9d06-3975fcbcd318"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 06:00:04.584663 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-34127d7a-9368-4830-81d6-dc0a59efadcd req-e7463dd0-c976-4662-b72e-3ba6e9ff29f8 service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:04.585400 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-34127d7a-9368-4830-81d6-dc0a59efadcd req-e7463dd0-c976-4662-b72e-3ba6e9ff29f8 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:04.586043 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-34127d7a-9368-4830-81d6-dc0a59efadcd req-e7463dd0-c976-4662-b72e-3ba6e9ff29f8 service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:04.606437 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-34127d7a-9368-4830-81d6-dc0a59efadcd req-e7463dd0-c976-4662-b72e-3ba6e9ff29f8 service nova] Creating event network-changed:bb2d58f3-53b0-416d-9d06-3975fcbcd318 for instance 13ea9c57-9074-4057-b7b2-9d27deb95268 on hv-cinder-85391 Aug 22 06:00:04.611645 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-34127d7a-9368-4830-81d6-dc0a59efadcd req-e7463dd0-c976-4662-b72e-3ba6e9ff29f8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046879 Aug 22 06:00:04.612254 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 601/1215] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 06:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 06:00:04.822742 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-9a41d54e-28b3-4bfb-825f-7827d0e161fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 06:00:04.824954 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-9a41d54e-28b3-4bfb-825f-7827d0e161fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 06:00:04.832106 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9a41d54e-28b3-4bfb-825f-7827d0e161fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:04.832585 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9a41d54e-28b3-4bfb-825f-7827d0e161fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:04.833012 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9a41d54e-28b3-4bfb-825f-7827d0e161fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:04.833732 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9a41d54e-28b3-4bfb-825f-7827d0e161fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:04.834174 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9a41d54e-28b3-4bfb-825f-7827d0e161fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:04.834597 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-9a41d54e-28b3-4bfb-825f-7827d0e161fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:04.864056 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-9a41d54e-28b3-4bfb-825f-7827d0e161fe tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046487 Aug 22 06:00:04.864623 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 615/1216] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 22 06:00:04 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 06:00:04.876137 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e6e6b1c8-2d79-46fc-9e0a-41527bab91ba tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 06:00:04.876795 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e6e6b1c8-2d79-46fc-9e0a-41527bab91ba tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 06:00:04.883649 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6e6b1c8-2d79-46fc-9e0a-41527bab91ba tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:04.884229 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6e6b1c8-2d79-46fc-9e0a-41527bab91ba tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:04.884738 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6e6b1c8-2d79-46fc-9e0a-41527bab91ba tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:04.885510 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6e6b1c8-2d79-46fc-9e0a-41527bab91ba tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:04.886031 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6e6b1c8-2d79-46fc-9e0a-41527bab91ba tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:04.886524 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6e6b1c8-2d79-46fc-9e0a-41527bab91ba tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:04.967718 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-e6e6b1c8-2d79-46fc-9e0a-41527bab91ba tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] HTTP exception thrown: Instance 13ea9c57-9074-4057-b7b2-9d27deb95268 is not attached to volume 8b89b366-7826-4f17-8494-67bb5acadbf7 Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e6e6b1c8-2d79-46fc-9e0a-41527bab91ba tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Request method failure captured: Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: DELETE /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/os-volume_attachments/8b89b366-7826-4f17-8494-67bb5acadbf7 HTTP/1.1 Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxq_t1NQckG_bCIpfDUKX0othFeDjKHOJuLg3WvKhQKEpEWQyQx0f6RFYlYlOf-D0Lm0cnSuSvFirrwNQJb8mKtA1prgpDlregGa1rVuyhEGHAI6KIUdi7QwomJNezinwYHrnZT6o578H1oop1oqwxKnlLUq0R905seLDY_PfqNEs5A Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 5f84b1b8d6e44140b80a668e08afcaff Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-TestMinimumBasicScenario-178262890 Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 06:00:04.970073 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 06:00:04.972243 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5f84b1b8d6e44140b80a668e08afcaff", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5f84b1b8d6e44140b80a668e08afcaff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5f84b1b8d6e44140b80a668e08afcaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5f84b1b8d6e44140b80a668e08afcaff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 06:00:04.972243 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-TestMinimumBasicScenario-178262890 Aug 22 06:00:04.972243 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 5f84b1b8d6e44140b80a668e08afcaff Aug 22 06:00:04.972243 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-TestMinimumBasicScenario-178262890 Aug 22 06:00:04.972243 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-TestMinimumBasicScenario-178262890-project Aug 22 06:00:04.972243 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 06:00:04.972243 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 06:00:04.972243 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 5e119e8e09aa4a8bb7cc96952f292833 Aug 22 06:00:04.972243 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-TestMinimumBasicScenario-178262890-project Aug 22 06:00:04.972243 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 06:00:04.972243 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 13ea9c57-9074-4057-b7b2-9d27deb95268 is not attached to volume 8b89b366-7826-4f17-8494-67bb5acadbf7 Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'server_id': '13ea9c57-9074-4057-b7b2-9d27deb95268', 'id': '8b89b366-7826-4f17-8494-67bb5acadbf7'} Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8b89b366-7826-4f17-8494-67bb5acadbf7. Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 06:00:04.973224 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 06:00:04.974991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 06:00:04.974991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 22 06:00:04.974991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 22 06:00:04.974991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ea9c57-9074-4057-b7b2-9d27deb95268 is not attached to volume 8b89b366-7826-4f17-8494-67bb5acadbf7 Aug 22 06:00:04.974991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 06:00:04.974991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 06:00:04.974991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 06:00:04.974991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 06:00:04.974991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 06:00:04.974991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 06:00:04.974991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 06:00:04.974991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 06:00:04.974991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ea9c57-9074-4057-b7b2-9d27deb95268 is not attached to volume 8b89b366-7826-4f17-8494-67bb5acadbf7 Aug 22 06:00:04.974991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 06:00:04.974991 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e6e6b1c8-2d79-46fc-9e0a-41527bab91ba tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Returning 404 to user: Instance 13ea9c57-9074-4057-b7b2-9d27deb95268 is not attached to volume 8b89b366-7826-4f17-8494-67bb5acadbf7 {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 06:00:04.976336 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e6e6b1c8-2d79-46fc-9e0a-41527bab91ba tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "DELETE /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/os-volume_attachments/8b89b366-7826-4f17-8494-67bb5acadbf7" status: 404 len: 154 microversion: 2.1 time: 0.099860 Aug 22 06:00:04.976336 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 602/1217] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 22 06:00:04 2022] DELETE /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268/os-volume_attachments/8b89b366-7826-4f17-8494-67bb5acadbf7 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 06:00:06.134510 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-e7fe805d-2eef-4c50-bceb-69670acf9401 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 06:00:06.135040 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e7fe805d-2eef-4c50-bceb-69670acf9401 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 06:00:06.141976 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e7fe805d-2eef-4c50-bceb-69670acf9401 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:06.142452 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e7fe805d-2eef-4c50-bceb-69670acf9401 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:06.142884 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e7fe805d-2eef-4c50-bceb-69670acf9401 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:06.143624 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e7fe805d-2eef-4c50-bceb-69670acf9401 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:06.144642 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e7fe805d-2eef-4c50-bceb-69670acf9401 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:06.145064 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-e7fe805d-2eef-4c50-bceb-69670acf9401 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:06.170243 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-e7fe805d-2eef-4c50-bceb-69670acf9401 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Going to try to terminate instance {{(pid=132497) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 06:00:06.248969 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-e7fe805d-2eef-4c50-bceb-69670acf9401 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "DELETE /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 204 len: 0 microversion: 2.1 time: 0.118030 Aug 22 06:00:06.249679 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 616/1218] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 22 06:00:06 2022] DELETE /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 06:00:06.258528 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-96eeb679-5d10-483a-b298-0f5e31a8cd58 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 06:00:06.259130 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-96eeb679-5d10-483a-b298-0f5e31a8cd58 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 06:00:06.265886 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-96eeb679-5d10-483a-b298-0f5e31a8cd58 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:06.266365 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-96eeb679-5d10-483a-b298-0f5e31a8cd58 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:06.266798 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-96eeb679-5d10-483a-b298-0f5e31a8cd58 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:06.267483 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-96eeb679-5d10-483a-b298-0f5e31a8cd58 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:06.267980 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-96eeb679-5d10-483a-b298-0f5e31a8cd58 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:06.268398 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-96eeb679-5d10-483a-b298-0f5e31a8cd58 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:06.412550 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-96eeb679-5d10-483a-b298-0f5e31a8cd58 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 06:00:06.424503 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-96eeb679-5d10-483a-b298-0f5e31a8cd58 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1553 microversion: 2.1 time: 0.169600 Aug 22 06:00:06.425429 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 603/1219] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 06:00:06 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 06:00:07.451645 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-ce9ccc68-5299-444d-bdce-cdbd75c26b46 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 06:00:07.452834 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-ce9ccc68-5299-444d-bdce-cdbd75c26b46 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 06:00:07.461027 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ce9ccc68-5299-444d-bdce-cdbd75c26b46 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:07.461502 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ce9ccc68-5299-444d-bdce-cdbd75c26b46 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:07.461931 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ce9ccc68-5299-444d-bdce-cdbd75c26b46 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:07.462622 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ce9ccc68-5299-444d-bdce-cdbd75c26b46 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:07.463069 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ce9ccc68-5299-444d-bdce-cdbd75c26b46 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:07.463857 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-ce9ccc68-5299-444d-bdce-cdbd75c26b46 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:07.600593 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-ce9ccc68-5299-444d-bdce-cdbd75c26b46 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 06:00:07.608787 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-ce9ccc68-5299-444d-bdce-cdbd75c26b46 tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1553 microversion: 2.1 time: 0.164271 Aug 22 06:00:07.609331 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 617/1220] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 06:00:07 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 06:00:08.559914 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-b52bad76-5d8c-431e-ab34-b2c45e17f919 req-973d6e9d-bba5-4d71-a35b-d632302c86ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ea9c57-9074-4057-b7b2-9d27deb95268", "name": "network-vif-deleted", "tag": "bb2d58f3-53b0-416d-9d06-3975fcbcd318"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 06:00:08.573011 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-b52bad76-5d8c-431e-ab34-b2c45e17f919 req-973d6e9d-bba5-4d71-a35b-d632302c86ef service nova] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:08.573573 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-b52bad76-5d8c-431e-ab34-b2c45e17f919 req-973d6e9d-bba5-4d71-a35b-d632302c86ef service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:08.574070 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-b52bad76-5d8c-431e-ab34-b2c45e17f919 req-973d6e9d-bba5-4d71-a35b-d632302c86ef service nova] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:08.587355 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-b52bad76-5d8c-431e-ab34-b2c45e17f919 req-973d6e9d-bba5-4d71-a35b-d632302c86ef service nova] Creating event network-vif-deleted:bb2d58f3-53b0-416d-9d06-3975fcbcd318 for instance 13ea9c57-9074-4057-b7b2-9d27deb95268 on hv-cinder-85391 Aug 22 06:00:08.592853 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-b52bad76-5d8c-431e-ab34-b2c45e17f919 req-973d6e9d-bba5-4d71-a35b-d632302c86ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036946 Aug 22 06:00:08.593446 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 604/1221] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 22 06:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 06:00:08.630544 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-a552b272-c00b-49e7-8c36-83d758d1af7e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 06:00:08.631213 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.compute.api [None req-a552b272-c00b-49e7-8c36-83d758d1af7e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132497) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 06:00:08.638656 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a552b272-c00b-49e7-8c36-83d758d1af7e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:08.639114 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a552b272-c00b-49e7-8c36-83d758d1af7e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:08.639546 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a552b272-c00b-49e7-8c36-83d758d1af7e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:08.640249 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a552b272-c00b-49e7-8c36-83d758d1af7e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:08.640700 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a552b272-c00b-49e7-8c36-83d758d1af7e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:08.641111 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a552b272-c00b-49e7-8c36-83d758d1af7e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:08.672174 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a552b272-c00b-49e7-8c36-83d758d1af7e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:08.672652 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a552b272-c00b-49e7-8c36-83d758d1af7e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:08.673077 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG oslo_concurrency.lockutils [None req-a552b272-c00b-49e7-8c36-83d758d1af7e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:08.673517 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.objects.instance [None req-a552b272-c00b-49e7-8c36-83d758d1af7e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lazy-loading 'fault' on Instance uuid 13ea9c57-9074-4057-b7b2-9d27deb95268 {{(pid=132497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 06:00:08.724319 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.policy [None req-a552b272-c00b-49e7-8c36-83d758d1af7e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e119e8e09aa4a8bb7cc96952f292833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f84b1b8d6e44140b80a668e08afcaff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132497) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 06:00:08.732409 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-a552b272-c00b-49e7-8c36-83d758d1af7e tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 200 len: 1348 microversion: 2.1 time: 0.106229 Aug 22 06:00:08.732956 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 618/1222] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 06:00:08 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 06:00:09.757362 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a087045f-3d67-4a45-a5c1-4116347c188f tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 06:00:09.758532 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a087045f-3d67-4a45-a5c1-4116347c188f tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] [instance: 13ea9c57-9074-4057-b7b2-9d27deb95268] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 06:00:09.766755 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a087045f-3d67-4a45-a5c1-4116347c188f tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:09.767320 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a087045f-3d67-4a45-a5c1-4116347c188f tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:09.767960 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a087045f-3d67-4a45-a5c1-4116347c188f tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:09.768890 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a087045f-3d67-4a45-a5c1-4116347c188f tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Acquiring lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 06:00:09.769545 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a087045f-3d67-4a45-a5c1-4116347c188f tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 06:00:09.769969 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a087045f-3d67-4a45-a5c1-4116347c188f tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Lock "129586bd-1da0-4623-9b26-5cb41c4ec3d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 06:00:09.784721 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-a087045f-3d67-4a45-a5c1-4116347c188f tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] HTTP exception thrown: Instance 13ea9c57-9074-4057-b7b2-9d27deb95268 could not be found. Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a087045f-3d67-4a45-a5c1-4116347c188f tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Request method failure captured: Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 HTTP/1.1 Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept: application/json Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Connection: close Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Length: 0 Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Content-Type: application/json Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Host: 10.222.0.18 Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.11 Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjAxq_t1NQckG_bCIpfDUKX0othFeDjKHOJuLg3WvKhQKEpEWQyQx0f6RFYlYlOf-D0Lm0cnSuSvFirrwNQJb8mKtA1prgpDlregGa1rVuyhEGHAI6KIUdi7QwomJNezinwYHrnZT6o578H1oop1oqwxKnlLUq0R905seLDY_PfqNEs5A Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Id: 5f84b1b8d6e44140b80a668e08afcaff Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-TestMinimumBasicScenario-178262890 Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Role: member,reader Aug 22 06:00:09.786367 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Aug 22 06:00:09.788050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5f84b1b8d6e44140b80a668e08afcaff", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5f84b1b8d6e44140b80a668e08afcaff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5f84b1b8d6e44140b80a668e08afcaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5f84b1b8d6e44140b80a668e08afcaff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Aug 22 06:00:09.788050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-TestMinimumBasicScenario-178262890 Aug 22 06:00:09.788050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 5f84b1b8d6e44140b80a668e08afcaff Aug 22 06:00:09.788050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-TestMinimumBasicScenario-178262890 Aug 22 06:00:09.788050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User: tempest-TestMinimumBasicScenario-178262890-project Aug 22 06:00:09.788050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Aug 22 06:00:09.788050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Aug 22 06:00:09.788050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Id: 5e119e8e09aa4a8bb7cc96952f292833 Aug 22 06:00:09.788050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-TestMinimumBasicScenario-178262890-project Aug 22 06:00:09.788050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: method: > Aug 22 06:00:09.788050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: exception: Instance 13ea9c57-9074-4057-b7b2-9d27deb95268 could not be found. Aug 22 06:00:09.788050 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: action_args: {'id': '13ea9c57-9074-4057-b7b2-9d27deb95268'} Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13ea9c57-9074-4057-b7b2-9d27deb95268 could not be found. Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 06:00:09.789061 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ea9c57-9074-4057-b7b2-9d27deb95268 could not be found. Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ea9c57-9074-4057-b7b2-9d27deb95268 could not be found. Aug 22 06:00:09.790640 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Aug 22 06:00:09.792323 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a087045f-3d67-4a45-a5c1-4116347c188f tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Returning 404 to user: Instance 13ea9c57-9074-4057-b7b2-9d27deb95268 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 06:00:09.792323 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a087045f-3d67-4a45-a5c1-4116347c188f tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268" status: 404 len: 111 microversion: 2.1 time: 0.037416 Aug 22 06:00:09.792323 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 605/1223] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 22 06:00:09 2022] GET /compute/v2.1/servers/13ea9c57-9074-4057-b7b2-9d27deb95268 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 06:00:09.797058 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: DEBUG nova.api.openstack.wsgi [None req-76a729c1-460a-44a9-b081-6f050952397a tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] Calling method '.version_select at 0x7f0b3e01aa60>' {{(pid=132497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 06:00:09.817412 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO nova.api.openstack.requestlog [None req-76a729c1-460a-44a9-b081-6f050952397a tempest-TestMinimumBasicScenario-178262890 tempest-TestMinimumBasicScenario-178262890-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-508942434" status: 202 len: 0 microversion: 2.1 time: 0.024424 Aug 22 06:00:09.817978 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: [pid: 132497|app: 0|req: 619/1224] 10.222.0.18 () {58 vars in 1269 bytes} [Mon Aug 22 06:00:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-508942434 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 06:01:40.842513 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 06:01:40.843729 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Mon Aug 22 06:01:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 06:02:47.368256 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 06:02:47.369206 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Mon Aug 22 06:02:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 06:03:22.014775 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 06:03:22.016182 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Mon Aug 22 06:03:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 06:03:22.352942 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 06:03:22.353626 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Mon Aug 22 06:03:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 06:05:00.857133 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 06:05:00.858448 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Mon Aug 22 06:05:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 06:05:15.887437 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 06:05:15.888510 dv-cinder-853910-1-iscsi devstack@n-api.service[132497]: Mon Aug 22 06:05:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 06:05:31.688544 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 06:05:31.689155 dv-cinder-853910-1-iscsi devstack@n-api.service[132498]: Mon Aug 22 06:05:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!